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Foundations 


of Modern Psychology 
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The tremendous growth and vitality of 

psychology and its increasing fusion with 
the social and biological sciences demand a new approach to teaching at the 
introductory level. The basic course, geared as it usually is to a single text 
that tries to skim everything—that sacrifices depth for superficial breadth 
—is no longer adequate. Psychology has become too diverse for any one 
man, or a few men, to write about with complete authority. The alterna- 
tive, a book that ignores many essential areas in order to present more 
comprehensively and effectively a particular aspect or view of psychology, 
is also insufficient. For in this solution, many key areas are simply not 
communicated to the student at all. 

The Foundations of Modern Psychology is a new and different ap- 
proach to the introductory course. The instructor is offered a series of 
short volumes, each a self-contained book on the special issues, methods, 
and content of a basic topic by a noted authority who is actively con- 
tributing to that particular field. And taken together, the volumes cover 
the full scope of psychological thought. research, and application. 

The result is a series that offers the advantage of tremendous flexibility 
and scope. The teacher can choose the subjects he wants to emphasize and 
present them in the order he desires. And without necessarily sacrificing 
breadth, he can provide the student with a much fuller treatment of 
individual areas at the introductory level than is normally possible. If 
he does not have time to include all the volumes in his course, he can 
recommend the omitted ones as outside reading, thus covering the full 
range of psychological topics. 

Psychologists are becoming increasingly aware of the importance of 
reaching the introductory student with high-quality, well-written, and 
stimulating material, material that highlights the continuing and exciting 
search for new knowledge. The Foundations of Modern Psychology Series 
is our attempt to place in the hands of instructors the best textbook tools 


for this purpose. 


Preface 


The first chapter of this book describes 

training a primitive flat worm to respond 
to a light with body contraction. To me, teaching this little beast to twitch 
on signal is still a bit of a miracle. It is, however, only a hint of the po- 
tential power given by the knowledge of the basic principles of learning. 
Through conditioning techniques we teach pigeons to play ping-pong or 
direct missiles; we control the temperature and blood flow in specific 
parts of the body. At the University of Michigan, in Dr. James Olds’ 
laboratory, I recently “contacted” a single nerve cell in the brain of a 
living white rat and trained this cell to increase and then decrease its rate 
of firing. The field of learning and behavior, a young science, can begin 
to look forward to the day when its potential for control of human beings 
will become a social problem. It is not unimportant that citizens be in- 
formed in these matters. 

The facts of learning are among the basic facts of behavior. For this 
reason learning principles have been applied in a variety of fields. Neurotic 
and psychotic behaviors have been productively studied as learning dis- 
turbances. In education, teaching machines are a direct product of operant 
conditioning principles; the teaching machine is likely to be an opening 
wedge in a rather belated application of learning principles to the field of 
education. In industrial and defense applications, principles of the learn- 
ing of motor skills are crucial in the design of man-machine systems. 

This list only begins to tap the surface of the topic. I recited the list 
both because I wish to emphasize the importance of the field and because 
with rare exception these applications are not mentioned again in this 
book. Instead the book contains a description of some of the salient basic 
facts we have gathered concerning the learning process. I have tried to 
take account of the most recent research, but have also made a conscious 
attempt to cite early work when possible. I would urge the introductory 
student to read this book in the sequence that it has been written. Chapters 


vi 


build on previous chapters. The early chapters provide a basic language and “feel” 
for learning research. These are then assumed in later chapters. 

I owe much to Dr. Howard Pollio for his help in drafting materials for Chapters 
3, 6, and 7 during the busy days at the University of Michigan just prior to my leav- 
ing for a year of research in Denmark. During my current absence from the United 
States he has carried the burden of procuring illustrations, proofreading, and pre- 
paring the index. Mr. Leo Hansen of Kommunehospitalet has been extremely 
generous in providing space and facilities for my work. My thanks also for the 
encouragement of my kind Danish friends. 

Dr. Richard Lazarus and Dr. G. Robert Grice both provided me with highly 
useful criticisms of various drafts of the manuscript. Benton J. Underwood taught 
me most of what I know about science and about learning; his review of the first 
draft of this manuscript both encouraged me and. more importantly, set me straight 
on some matters he had not quite attended to while I was still a student. Miss Karin 
Winther Pedersen patiently and skillfully typed and retyped this manuscript. 


Sarnof A. Mednick 
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Some Examples 


of Research on Learning The planarian (Dugesia 


dorotocephala) is a primitive flatworm that tends to 
dwell on the underside of rocks in mildly stagnant, pol- 
luted water. In many ways the planarian, only three- 
quarters of an inch long, is an outstanding creature (see 
Figure 1-1). From the point of view of evolutionary de- 
velopment, however, it must be confessed that he has not 
come very far in complexity. Despite this considerable 
handicap, planaria can learn, as experiments have proved. 
The method used to induce them to do so is a good start- 
ing point for studying learning, since it involves one of 


the simplest types of learning psychologists investigate. 
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Figure 1-1. In terms of evolution planaria are the earliest organisms to 
have developed a concentration of nerve fibers that could be called a “brain.” 
Because of this, researchers have been interested in the planarian’s ability to 
learn. The first four panels of this figure are discussed in the text. When a 
light and electric shock are paired, as in Panel 3, planaria eventually learn 
to respond to the light with contraction, the response they ordinarily give to 
the shock (as in Panel 4). If a planarian is cut into pieces each piece regener- 
ates a complete organism. James V. McConnell, Allan L. Jacobson, and Daniel 
P. Kimble took planaria which had learned to contract to the light and cut 
them in half (Panels 5 and 6). They then allowed the halves to regenerate as 
in Panels 7 and 8. The question was: if each half was then tested with the light 
would any memory be shown? Would the head end show better memory than 
the tail end? As is iilustrated in Panels 9 and 10 both heads and tails showed 
retention of the light—contraction association. What was of special interest is 
that there was no difference in the amount of retention exhibited in the head 
and tail ends. The intriguing question stemming from this research is, how 
does retention occur in the tail section? Some very recent evidence suggests 
that it is partially chemical in nature. (Courtesy Science et Vie.) 


An experimenter can get a planarian to learn to make a certain response, 
a simple body contraction, whenever he turns on a 100-watt light bulb, located 
six inches above the planarian’s head. We can assume that the flatworm learns 
this response to the light stimulus because when the lamp is first turned on, 
for three-second flashes, he takes little notice. But during training, in the last 
of the three seconds that the light remains on, he is regularly jolted with an 
electric shock delivered through the water. He need not learn his response 
to the shock; it is a reflexive body contraction. If the light and shock are 
presented together about 250 times the contraction response will reliably 
occur with only the light. Clearly, the humble planarian has learned to respond 
to the light he previously ignored. 

Such a change in behavior as a result of experience is learning. In the 
remainder of this chapter we shall skim across the field that psychologists call 
learning, touching down periodically to illustrate a method or to introduce 
a theory. This brief survey of “learning psychology” is intended to give you 
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a quick glance at a map showing the whole of this area before leading you 
down the first side street. 


Conditioning 


The method of training 

used with the planarian is called classical conditioning. It consists of repeatedly 
pairing a neutral stimulus (in this case the light) with a stimulus (electric 
shock) which invariably elicits a response (contraction) until the neutral 
stimulus alone will elicit the response. It is based on a method of conditioning 
first systematically investigated by the Russian physiologist Ivan Pavlov. 
In later chapters we shall consider classical conditioning and the work of 
Pavlov in great detail, for despite its apparent simplicity classical conditioning 
has wide implications for human behavior. Psychologists were forced to use 
the modifier “classical” when a new kind of conditioning, operant conditioning, 
was first systematically studied and reported by B. F. Skinner in 1938. 
Although Skinner did most of his original work with white rats as laboratory 
subjects, his methods have found broad application. 

To give you an idea of what this second sort of conditioning is, it might 
be best to start with an example, a project being conducted in an operant 
conditioning research laboratory in a mental hospital in Massachusetts. 
Experiments are carried on in specially constructed rooms that happen to be 
in the basement of the building. Dealing with very seriously disturbed patients, 
the experimenters have often found it quite difficult simply to get the patients 
to come down to the experiment rooms. An undergraduate from a nearby 
university, well versed in operant conditioning procedures, took it upon him- 
self to attempt to bring a patient with a long-standing mental illness to one 
of these rooms, Illness had reduced this patient to an almost animal state. 
He had little or no control over defecation or urination; he would often bite 
individuals who came too close to him; he did not speak. Consequently, he was 
kept in virtual isolation. 

In order to get him downstairs, the student used an operant conditioning 
technique called “shaping-up.” In this method the experimenter continually 
rewards acts that come closer and closer to some ultimately desired behavior. 
Thus, the student waited for the first time the patient turned his head toward 
the door leading to the basement stairs. At this point he presented the 
patient with a small piece of candy which the latter quickly ate. (It had been 
previously determined that the patient liked candy.) Presently, the patient 
faced the door again, and again the student was there with a piece of candy. 
After a number of such incidents the patient simply stood facing the door. The 
candy acted as a reward for door-facing and increased the likelihood, or 
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probability, of its occurrence. After this phase of training was completed, the 
student withheld the candy until the patient took a step. When the patient 
had received candy several times for taking steps, the student again with- 
held candy until he took steps in the direction of the basement stairs. After 
a number of days, during which there were many reversals and disappoint- 
ments, the patient actually walked down the stairs, entered a basement room, 
and went through the experimental procedures. This was the first time in some 
years that the patient had behaved in such an organized manner. 

i This example of shaping-up illustrates the effectiveness of systematically 
administered reward, the most important feature of operant conditioning. The 
shaping-up method has recently been applied to education via teaching ma- 
chines. The pupil is rewarded for progressing in small stages in acquiring the 
desired information. 

Operant conditioning differs from classical conditioning in certain ways. 
For example, classical conditioning only applies in situations where a response 
is inevitable; in the planarian, for instance, contraction is an automatic reflex 
to electric shock. In operant conditioning, by contrast, the experimenter must 
patiently wait for the response to occur naturally before he can increase ite 
probability with a reward. We shall discuss this and other differences and their 
implications in Chapter 3. 


Maze Learning 


We can analyze both clas- 
g in terms of stimuli, responses, and rewards. In 
these units as they combine in complex series, psychologists 
number of appropriate procedures. Among these the maze has 
e most widely used with animals, The simplest form is the 
maze (Figure 1-2) wherein an animal must choose between a left or right 
turn at the point of choice. If he chooses correctly he is rewarded with food 
in the goal box. The set-up may be further complicated by adding more points 
of choice, as in the multiple T-maze (Figure 1-3), 
D. A. MacFarlane used a maze in a clev 


theory that had been advanced by John B. 
that what 


maze, but 
turning lefi 


sical and operant conditionin 
order to study 
have devised a 
been one of th 
Te 


er experiment designed to test 4 
Watson. Watson had suggested 
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Goal-box door Goal-box door 


EE Choice-point | 
ic joBianes ee ei 


Photocells 


Figure 1-2, Drawing 
of a simple T-maze. Rat 
is placed in the starting 
box and when he is fac- 
img forward, the door is 
raised. The door is closed 
to prevent the animal 
from retracing its steps. 
When the animal crosses 
photocell 1, the first Start boxdco, 
clock is stopped, giving on 

a measure of running [2] [2] Start- 
time from the opening I 2 

of the start box door 

to reaching the choice 

point. When the animal i pak sin EE 
reaches either photocell 2 or 3, clock 2 is stopped, | an $ 
time from te the start box door to reaching one phat og sgl 
the rat enters the goal box the door is dropped Wy delan Hig ies hology 
consumes the reward. (From DJ. Lewis, Scientific principles of psychology. 


Englewood Cliffs, N.J.: Prentice-Hall, 1963.) 


ving a measure of the total 


Figure 1-3, A sche- 
matic representation of a 
multiple T-maze. The 
door here shown is at 
the entrance; interior 
doors are not shown. Start 


beneath the surface of the water. Now the rats had to wade. Since movements 


in swimming and wading are quite different, Watson would have predicted a 
great confusion as a result of this change- Asa matter of fact, almost no con- 
fusion occurred. The rats waded through the maze ont preat aplomb and a 
errors, thereby casting considerable doubt on the W aisonian eA en 

Seems clear that rats learn something more than a series of body movements 


when they learn to traverse a maze. 


Goal 


Some 
Examples 
of Research 


on Learning 


Some 
Examples 
of Research 


on Learning 


Mazes have also been utilized to study how humans learn a series of re- 
sponses. The original model for such mazes was the complex arrangement of 
hedges that is found at Hampton Court Palace, in England. But since such 
a magnificent set of hedges may take up to eight years to grow, psychologists 
have developed more conventient devices such as table models that simply 
require a subject to find his way by tracing a path with his finger. 


Verbal Learning 

Besides mazes, psycholo- 
gists also use various forms of verbal tasks in studying learning. In one 
method, called serial verbal learning, they ask people to learn to connect a 
series of words in order to evaluate the factors affecting their ability to 
learn serial tasks. One of the pioneers in_ verbal learning research, Hermann 
Ebbinghaus, wished to study the process of verbal learning without the 
troublesome contaminating effects of the previous experience people have with 
words. To circumvent this problem he devised a new verbal unit that could not 
have been previously experienced—the nonsense syllable. Nonsense syllables 
are relatively meaningless three-letter combinations composed of a vowel 
flanked by two consonants, for example, XAD. Ebbinghaus’ idea of avoiding 
the effect of old habits by using novel nonsense syllables was a brilliant ex- 
perimental innovation, but it proved to be only partially successful. For it 
was soon discovered that even nonsense syllables are affected by previous 
experience, For example, SYN is close enough to a popular English word to 
function in learning experiments almost the same way as does the real three- 
letter word. This Property of nonsense syllables is called meaning fulness ; lists 
of nonsense syllables have been rated for their meaningfulness by determining 
how regularly these syllables tend to suggest associated words or ideas to 

groups of judges, 
John A. McGeoch conducted an experiment to determine what effect this 
Property has on the ease of learning nonsense syllables, He arranged groups 


The Amount of Recall as a Function 
of Meaningfulness of Learned Material 


i Mean Number 
Mat i. i 
aterial in a List of Ten 
3-letter words 
High-meaningful nonsense syllables 738 
Medium-meaningful nonsense syllables a 
Low-meaningful nonsense syllables ae 


5.09 
From McGeoch, J.A. J. genet. Psychol., 1930, 37, 425. 


of ten nonsense syllables each into three lists that differed in their meaning- 
fulness (very high, medium, very low). In addition, he used a fourth list of 
real three-letter words. He allowed subjects to study each list and then asked 
them to recall as many items as they could. The types of lists and the average 
number of items recalled from each appear in Table 1. As you can see, people 
recalled more and more items in a list as the meaningfulness increased. 


Mediation 


Many other studies using 
a variety of materials have confirmed these results: The more mea 
material the faster people can learn it. One possible interpretation of this 
finding, although by no means the only possible interpretation, suggests that 
Meaningful items facilitate learning largely because they have appeared in 
Many contexts and have a variety of associations that can help bridge the gaps 
among them. The learner may not even be aware of this bridging process. For 
example, adopting the method of a study by Wallace Russell and Lowell 
Storms, I taught college students to associate a word to a nonsense syllable 
and then tested them to see whether this prior experience could serve as a 
bridge in learning a different but related word in association with the same 
Nonsense syllable. Learning to associate a pair of verbal units is abel 
Propriately enough, paired-associate learning. In this study subjects see sn 
associate a list of pairs containing XAD—doctor and then were teste i : 
having to learn a list of pairs containing XAD—Indian chief. Because i a 
learned the pair XAD—doctor and had previously Jearned the phrase “doctor, 
lawyer, Indian chief,” the words doctor and lawyer apparently served as A 
bridge to learning the pair XAD—Indian chief. Furthermore, the latter pair 
Was learned more quickly than other pairs that lacked such a bridging se- 
quence, It is noteworthy that in such experiments subjers are almost S 
able to report any of the bridges, Or indeed anything at all concerning this 
Process, This suggests that bridging can occur outside of eine oer 
Sciously, As might be expected, “aware” learners benefit the mos g 
ing. This type of bridging in learning is called mediation. S 
As promised we have introduced some examples of the way learning is 
Studied, 


ningful the 


Classical conditioning in the planarian. i 
Operant conditioning of a mental patient. 
Maze learning in the rat. : 
Nonsense-syllable verbal learning. ob 
Paired-associate verbal learning and mediation. 
observing how one very important 


waswne 


We shall now continue this survey by Some 


Variable, motivation, affects learning. Examples 
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Learning is a sensitive process that is easily affected by changes in 
learner or in the environment. In the pages that immediately follow We s a 
present some examples of experiments that test the effect of variations in 
motivation. We shall consider three aspects of motivation. 


i x 

1. As an energizer of behavior (a hungry rat runs very quickly to find a goal bo 

containing food). : ; ee 

2. As an internal sensation to which an animal may learn to behave selectively 

(we eat when hungry and drink when thirsty). od ado 
3. As a state of imbalance that can be rectified, thus resulting in a con 


i i j he 
known as reward or reinforcement (if the state of imbalance is one of hunger, t 
appropriate rectifier would be food). 


Motivation as an Energizer 


Perhaps we can most 
clearly demonstrate the role of motivation as an energizer of behavior by 
pointing up the difference between learning and performance. The crucial 
differentiating element is that you can see performance. To “see” learning 
you would have to cut subjects open somehow and look in the right place, at 
the right time, in the right way. At our present state of technological advance- 
ment this is impossible, and besides, doing so would spoil subjects for other 


; n 
things. Let us take an example. Say we place a hungry rat that has beer 
deprived of food for 24 hours in a T-maze with 


a one-gram chunk of rat food 
in the left arm of the maze. After 


a number of successful trials, following 
each of which he is put back in the starting box and new food is placed in the 
goal box, the rat will run quickly and unhesitatingly to the goal box, showing 
that he must have learned where the food is located and how to get there. After 
about 15 trials, however, the rat will become increasingly reluctant to leave 
the starting box. He may simply find himself a comfortable corner and go t° 
sleep. The reason is simple; after 15 such trials he will h 
of food, which is just about the rat 
Why isn’t the rat still performin 
satisfied and he is no longer motiv. 
not diminished, though. If he wake: 
ability to run the maze with speed 
both learning and motivation for 
will simply result in random activit 
result in inactivity, such as sleep. 


ave eaten 15 grams 
equivalent of a five-course dinner. 

g? The answer is that his hunger has been 
ated to perform. His level of learning has 
s up hungry he will quickly demonstrate his 
and without error. It is clear that we need 
Performance. Motivation without learning 
y; learning without motivation will simply 
Some 


Examples One of the most influential Motives in civilized society is anxiety. You 
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yourself may not have experienced serious hunger, thirst, or oxygen depriva- 
tion recently, but you probably have experienced some anxiety—consider 
the time of your last final exam. Anxiety as well as hunger can motivate 
learning in animals and men. If we were to electrify the floor of the maze, 
we would quickly see the massive energizing effect a little appropriately ad- 
ministered “motivation” has on our sleeping rat. Further, if we provided an 
island of safety from shock in one arm of the maze, the rat would soon learn to 


Tun there to escape. 


Motivation as a Cue 


After a long walk in the 
hot sun we begin to experience dryness in throat and mouth; we dub these 
feelings thirst. When we feel them we look for a drink. Our seeking demon- 
Strates again the energizing property of motives. That we would bypass dry, 
salted Popcorn for a tall glass of beer points up the association with specific 
Motives (thirst) of individual internal stimulus patterns (dry mouth and 
throat) that direct behavior. Fear too can have such an effect. Mark May 
Conducted an intricate experiment showing how fear can produce an internal 
Stimulus pattern to which a rat can learn a specific response, just as though the 
stimulus were external, such as a light. The experiment was conducted in 


three Stages, as follows: 


1l. May placed rats into compartment A of a-twoecompartmenk bas Menmi 
were separated by a low hurdle. He then electrified the floor 0 pee i : 
e rats showed all the usual signs of fear including urination. — me i na 
crouching, They soon learned, however, to jump the hurdle into the sal ety o 
compartment B to escape the shock. Note that the shock evoked fear, which was 
One of the stimuli that jumping the hurdle. 
muli that led to jumping the © ; ; , 

2. The hurdle was removed and the rats were trapped in a cov ered one K me 
center of the box so that they could not jump. He ue moore E gein 
same ti p ; ably learned to fear 5, ; 

ime sounded a buzzer. They Lage ee en should produce 
learned that when these fear stimuli are 
Present he sh s 
ould jump the hurdle to escape. , 

3. To test this nn a May replaced the hurdle in alg wih E bon 
Placed the rats one at a time in compar d sounds) poe sn 
buaigh, the rats immediately jumped t The, seguens E ani 

zzer —> internal fear stimuli —> jump- 


he hurdle. 


“of course the rats jumped the hurdle; 
energized into doing something and so 


they jumped. It is crucial to your argument to demonstrate that the rats 
actually experience the fear stimuli in response to the buzzer. Suppose you 
take some rats and train them to jump the hurdle to escape just as May did 
(Step 1). Then (Step 2) trap the rats in the center of the box as before (with 


‘ 
ih ‘But wait,” the skeptic might say, 
€y were startled and were merely 


Some 
Examples 
of Research 


on Learning 


Some 


Examples 
of Research 


on Learning 


the hurdle removed), but instead of sounding the buzzer and shocking them 
at the same time, give them the same number of shocks as the other rats, and 
sound the buzzer as often but don’t present the buzzer and shock at the same 
time. Now, because the buzzer and shock have not been presented together, 
the buzzer should not cause fear in the rat. May would then predict that in 
the third stage, the second group would not jump the hurdle when the buzzer 
was sounded. If they do jump the hurdle it is clear they do so because it is 
the only thing they can do, not because the buzzer brings on the fear stimuli 
to which the jumping response was trained.” 

As a matter of fact, in anticipation of such criticism, May did train a con- 
trol group of rats in the second manner. In comparison to his experimental 
group, however, very few of the control group jumped the hurdle when the 
buzzer was sounded. Clearly then, the buzzer elicited in the rats distinct fear 
stimuli in response to which they had learned to jump. 

Like the rats, we all have learned to make certain responses when we are 
anxious or fearful. When some people feel anxious, they nervously go about 
straightening up tie or desk; when an adolescent feels anxious, the classic 
response is to look down at the floor and go through some intricate foot 
shuffling. It has been suggested that unusual and aberrant thinking is actually 
a response a mentally ill person has learned to make when he feels fearful. 


The “crazy” thinking allows him to escape from current reality and conse- 
quently serves to reduce his fear, 


Motivation as a Need To Be Satisfied 

In the operant condition- 
ing of the schizophrenic patient described above, the student waited for the 
desired behavior to occur and then presented the patient with candy. When 
the rat jumped the hurdle, he escaped the electric shock. When the hungry 
rat went down the left arm of the T-maze he received one gram of rat food. 
Each act was concluded with some favorable experience; such an experience 
is usually called a reward or reinforcement, As a tule, behavior that leads to 
reinforcement or regularly precedes reinforcement, tends to recur. In fact 


some psychologists turn the emphasis around and simply define reinforce- 
ment as anything that increases the probabilit 


rae y of behavior that systematically 
precedes it. 


One theorist, Clark Hull, maintains that reinforcement is brought about 
by the reduction of a need. For instance, when a rat eats the food in the left 


arm of the T-maze, his hunger is reduced. This approach has raised a number 
of questions. One is: When does the reinforcement involy 


ed in eating actually 
occur? There are several possible ways of asking this qu 


estion. 


I0 


i ya the food first enters the organism’s mouth? 
re : $ the food is on its way to the stomach? 
nae 0 When ‘the food reaches the stomach? 
ode en the food” enters the blood stream? 
it when the “food” is utilized by a body cell? 


Me BS SS 


Poti re been a number of attempts to achieve answers to these ques- 
Bee son eet one of them. In an effort to test the fourth choice, 
andi by edie and Randall M. Chambers strapped a hungry rat to a board 
esa rhe <a him carefully, determined which way ie preferred to turn his 
kied ave definite individual pieterenices i this regard). They then 
rena needle into the hungry rat s caudal vein so that they could, at will, 
thus PER amount of sugar solution directly into his blood stream. They 
Koet him a little sugar solution every time he turned his head to his 
ena As side. If this type of “feeding” coul 
ton omen soon learn to change the direction ot Bis =% ‘ 
indeed, bot apa Chambers reported that through this injection they did 
identical r i e rat’s preference. A control group of hungry rats were treated 
dine B except that they were “fed” with a salt solution: These animals 
iho oe to turn their heads in the nonpreferred direction. Clearly it was 

ivation-reducing property of the sugar solution that was crucial rather 


than sj 
an simply the addition of some liquid to the blood. 


d serve as a reinforcement, 
f his head-turning pref- 


ee foregoing examples of research relatively low-level instances of 
Sues Have been emphasized. In this section something shall be done to 
aae this unbalanced picture. Perhaps I can most appropriately begin by 
ity tan some ofthe research of aman whose work was aimed at correcting 
eens for psychology as a whole. ; 

experim an island off the coast of Africa, W ol 
ddings Th that were aimed at challenging 
group a —— during World War I on 
of Ape on umipanizees, Köhler took the opportu 
tees S (the title of his book). Köhler’s work was, ih part, an attempt to 

earlier experiments by Edward L. Thorndike which suggested that ani- 
mals are planless, generating merely rand ponses when confronted with 
a Problem. In this view, they aiy “solv when some trial-and- 
po behavior gains in strength aga result of being followed by reinforcement. 
Köhler’s observations led him to question this He suggested that if the 


fgang Köhler reported a series of 
simplistic explanations in psy- 
this island, which had a native 
nity to study “The Mentality 


om res 
e” a problem 


view. 


Ii 


Some 
Examples 
of Research 
on Learning 


Some 
Examples 
of Research 


on Learning 


relevant objects were clearly presented, animals could solve problems insight- 
fully by seeing the relationships between the items. Once an animal had 
insight it would pass from random behavior to perfect performance in one 
trial, not improve gradually, reinforcement by reinforcement. 

Why did Kohler come to this conclusion? In one experiment he placed a 
chimpanzee and a stick in a cage. Outside the cage was a banana. The chimp 
first tried to grasp the banana with his hand but it was out of reach. Eventu- 
ally he picked up the stick and played with it. At one point he suddenly 
rushed to the bars with the stick, reached out and swept in his prize. The 


change in behavior was sudden and complete as though insight had occurred, 
not slow and gradual. 


in this pat situation. As it turned out this chimp had had previous experience 
along these lines. In an attempt to generate relevant conditioning as suggested 
by Pavlov, Birch allowed the chimps free play for some time with sticks. After 


An instructive analogy may be drawn between these insight experiments 
uman beings. Norman 
of ingenious methods 
for studying how human adults attack problems. One of these is depicted in 


e two ropes together; 
he may use anything in the room. There are a number of solutions possible; 


ally cannot reach the 


was “rope” and its respons 


A e was “swing” 
to “rope” with 


f “hemp.” The individuals 
(rope—swing) were more likely to arrive 


; other subjects learned to respond 
with the relevant previous training 
at the “swinging” solution. These 
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Figure 1-4, The two- 
rope problem. The object 
is to Join the ropes. One 
ly is to tie pliers 
mee of one of the 
ire, id to set it swing- 


Pliers i 


plays in higher mental proc- 
d associations are crucial. 
higher mental 


pie aii the role previous learning 

The aE T that certain fundamental habits an 

Processes oan ity of these associations determine how easily 
ch as problem-solving are carried on. 


ve attempted to give you a feeling 


In i P 
presenting this research sampler I hav 
he subjects studied by researchers 


for t 
in n breadth of the material covered and t 
e field of learning. In the following chapter we shall attempt to step 


me from these specific instances and descriptions of research and attempt to 

ace some of the underlying similarities in terms of common. e 

and S also get a picture of how a research problem 1n learning is planne 
signed and how it is carried through to the final results. 
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and Methods of Learning 


In Chapter 1 tne survey covered a wide span—from con- 
ditioning of the planarian to human problem solving. You 
may wonder about the relationship between these ex- 
tremes. Is there a continuum in learning from simple 
creatures to man? Although we can hardly imagine pre- 
senting complex problems to planaria, we do know that 
it is quite simple to condition responses in human beings. 
Also, the basic laws of conditioning seem the same as we 
move from one species to the other. In fact, we find that 
most of the fundamental laws of learning we derive from 


research on lower animals apply as well in research on man. 
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Then 

why do 

PIOSAN se the research on lower organisms in the first place? There 

many ons. i ienti i 

eee 5 For one thing, some scientists who study learning just 
wW with animals because animals are their major interest. For 


another, this ty 
, this type of work feeds on itself. There is a thick handbook con- 
he white rat. So much is 


animal that an 
has much of his 
diately focus on 


cer] " k 
— pees with psychological research on t 
investigator ae behavior of this ubiquitous laboratory 
background nite a cena D an Aa Aoi 
the specific oa ready completed for him and can imme 
is mananc a engaging his interest. 
immoral, tae ae researchers use dogs or rats as subjects where it is 
acute E a H r simply inconvenient to use people. When the effect of 
effect of mee aia to an area of the cortex is being studied, or the 
Motte is: the ont aised from birth in a specific restricted environment, animal 
paesana & a and legal recourse. In Birch’s emenmen with ata 
relatively Senet z saw the advantage of observing an animal with a 
istory of conditioning and learning. As you will recall, 


one ¢ 

of the six chimpanzees solved the problem on the first try. Birch notes 
one that had had extensive experience 
ly life. In an experiment that 
control the extra- 


aene tas 
in sb ina sete was the only 
Stretches eines in his pre-experimental dai : 
experimenta] lays ang weeks it is often crucial to strictly ) 
again. experiences of the subject; s0 animals in cages Wn out once 
for the use of lower animals in learning 

grew from philosophy. The 
in the main of intuitive and 


iu r 
a po ae one more reason 
philosophies . all other sciences psychology 
Searching fe darn at studying man consisted e ' 
Others, Self-c sexplorations and thoughtful consideration of the behavior of 
quarter of A building a science, certain psychologists in the first 
Measurab] is century aggressively rejected any attempt to study such un- 
Events ae and secret things as thoughts- They wished to study tangible 
not as tan could be seen in the plain light of day and measured. Thoughts are 
addition gible or as easily measured as 2 T nning a maze. In 
Voluntar, when we put a man into & simple learning situation involving a 
Ne niche such as an arm movement, he is always thinking. These 
an fale p determine his behavior. They are unmeasurable and constitute 
Cannot ei quantity in the experiment. If the rat 15 thinking, at least he 
Chologists arass us by telling us about it. These considerations led psy- 
animals E learning at the beginning of the century tO work with 
- Since then, however, We have devised methods for the scientific 


stud 
“i ce the thinking itself. 
m . 
efore ESS point: If we wish to know 
could “think” about it, we must stud. 


at’s speed in ru 


an arm movement 


n learned 
hat do not already 


how a ma 
y organisms t 
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Possess complex symbolic habits. For this purpose investigators turned to 
young children and lower animals. 

Now, for a caution: We can never blindly assume that findings from 
animal research apply to human beings. Any specific research findings using 
animals must first be checked out with people. Where such findings cannot 
be checked on human beings because of the danger or discomfort of the 
procedures, generalization must be restricted since it will be based on indi- 
rect evidence. Why this concern with generalizing from animal research to 
humans? One of the things that scientists treasure most in their research 
and theory is elegance. One of the important components of elegance is 
parsimony, Parsimony is a rule of science which maintains that the world and 
its actions should be explained in the fewest possible number of laws. Clearly, 
if we can explain the behavior of both animals and men with the same set of 
laws, we are being parsimonious. 


Examples of Unlearned Behavior 

Almost all adult human 
behavior is learned. Some behavior is reflexive or instinctive; we breathe, our 
heart pumps; our cells apparently teem with activity; our knees jerk. All 
of this behavior takes place without the benefit of learning. As we move 
down through lower animals, reflexes and instincts account for more and 
more of their behavior. There is sometimes a danger that a learning psy- 
chologist will ascribe to past learning some complex behavior that is actually 
instinctive. Take the baby duck. Ducklings characteristically tend to follow 
their mothers. It would be rather easy for the learning psychologist to explain 
this behavior from his armchair, The duckling follows the mother because 
it is often reinforced for doing so. It has, however, been demonstrated oat 
this behavior is instinctive, occurring without any learning. At a certain 
crucial time, some hours after emerging from their shells, newborn ducklings 
can be induced to waddle after anything from a football to an experimenter 
that is moving nearby. The induction is accomplished by simply exposing the 
ducklings to the moving objects. They will continue to follow these objects 
from then on. This behavior, called imprinting, is not learned. Ethologists, 
who study comparative behavior, have observed even more complex un- 
learned behaviors. Let us examine one in some detail. 

The subject of this examination is the stickleback, a relatively unobtrusive 
fresh water fish whose name derives from the bony spines that extend from 
its back. We mention the fish here because of its remarkable behavior pat- 
terns for courtship, mating, and defense. The male begins his courtship by 
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constructing an underwater nest. 
In order to make this nest into a 
home, the male stickleback must 
attract a suitable female. He ap- 
proaches female fish only if they 
are receptive; female sticklebacks 
who are receptive advertise their 
condition by exhibiting a swollen 
abdomen. The male, in turn, com- 
municates his interest by develop- 
ing a red underbelly and by per- 
forming an intricate zig-zag dance. 
During this courtship period, the 
male stickleback defends the nest 
against other sexually active 
males, who are easily recognized 
by their red undersides. No red 
underbelly, no attack. 

A series of experiments has 
shown that the occurrence of these 
complicated acts depends on spe- 
cific stimuli in the environment of 
the stickleback. Thus, a mature 
male will make a sexual approach 
to a dummy fish, but only if the 
dummy has a swelling in the area 
of the abdomen (see Figure 2-1). 
The dummy need not resemble the 
female stickleback much; about all 
na needs is the abdominal swelling. 
Similarly, the sexually mature 
Se will attack dummies that bear 

e resemblance to other stickle- 
backs, provided they have red 
underbellies. 


nyn, 
ADE 


Figure 2-1. Dummies used 
to induce fighting in male 
sticklebacks. When a faithful 
model lacked the red under- 
belly there was no attack. The 
models labelled R, which have 
red under-bellies, all provoked 
fighting. (From V.G. Dethier 
and Eliot Stellar, Animal Be- 
havior, 2nd ed. Englewood 
Clifs, NJ. Prentice-Hall, 


1964.) 


off successfully even 


All this highly complex social behavior is carried 


though a stickleback need never have le 


behaving in such a manner. This intricate aie 
backs when they are hatched. All that is necessary to elicit it is the occur- 
rence of the releasing stimulus—the red belly or the swollen abdomen. Given 


the releasing stimulus, the response sequence is a foregone conclusion. 


arned it, or seen other sticklebacks 
behavior pattern is built into stickle- 
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A Definition of Learning 
We have devoted some 


space to stating what learning is not. What is it then? Learning has a number 
of defining characteristics. 


1. It results in a change in behavior. We note a change in the planarian’s 
response to the light. Now when it is presented the animal contracts. 

2. It comes about as a result of practice. This characteristic eliminates 
sources of change such as illness and maturation, Recall the potent effects 
of motivation on behavior mentioned in Chapter 1. Changes in behavior 
caused by such variables are not considered learned. 

3. They are not considered learned because they are temporary changes. 
Learning, though, is a relatively permanent change. After a rat wakes up from 
his nap he still remembers the path to the food. Even if you have not been 
on a bicycle for years, in just a few minutes’ practice you can be quite pro- 
ficient again. Continued practice at a well-learned task, however, might 
result in fatigue and poor performance. This change in behavior as a result 
of practice would not be considered learning since it is not permanent. A little 
rest will bring the performance up to par again. 

4. Learning is not directly observable. We distinguished between learning 
and performance in Chapter 1. Learning is only one of the many variables 
influencing performance. Nevertheless, the only way to study learning is 
through some observable behavior. In research we often try to subtract the 
effects of all irrelevant variables by the use of a control group. If we are 
studying the effect of amount of work on speed of learning a maze, we might 
study rats with high hunger motivation running in a maze with a heavy load 
strapped to their backs, Despite the complicating effects introduced by the 
high motivation, we need it in order to get the rats to run in the maze. For 
a control group we may study a group of litter-mates running in the maze 
with identical hunger motivation but with only a pack of balsa wood on their 
backs. When we subtract the balsa-wood-group's results from the heavy- 
pack-group’s results, we must ascribe any difference in maze performance to 
the effect of the heavy load since otherwise the groups are identical. May 
we now say we have observed differences in learning? No! These are only 
differences in performance. If we want to study pure learning differences We 
must now test both groups of rats in the maze either without any packs or 
with both groups wearing identical heavy or light packs (we would probably 
split our original groups and try all three). If we now find no differences in 
maze-running ability, then we can deduce that although amount of work has 
an effect on performance, it has no effect on learning. 


We have already pointed out that we cannot actually observe learning; 
we see only what precedes performance, the performance itself, and the conse- 
quences of performance. Before proceeding to the complexities of this process 
it might be worthwhile to pause to define some words related to these three 


observable events. 


What Precedes Performance 


What precedes an act we 

usually call a stimulus, Stimuli can be as arresting and complex as the activities 
of an Egyptian belly dancer or as innately boring and simple as a pure tone 
and intensity. The buzzer in May’s hurdle-jumping 
er, so too was the complex of feelings 


ig- 


of moderate frequency 
experiment was a stimulus; howev! 
associated with fear. This latter type of stimulus grows from impulses or! 
inating inside the organism and consequently is usually called an internal 
stimulus, You could argue that, technically, all stimuli are internal since they 

are not effective until they stimulate a sensory organ, such as the retina of the 

eye, and at that point they are quite “internal.” Still, pragmatically it is use- 

ful to distinguish stimuli that clearly originate outside an organism from 
those that are within, Feelings of being thirsty or hungry are internal stimuli; 
proprioceptive is the special name applied to internal stimuli resulting from 
muscle movement. We are usually unaware of most of the internal stimulation 

that regulates our behavior. Did you realize that you were breathing 15 
minutes ago and that this breathing was producing internal stimuli? 

We measure stimuli. We use foot-candles to measure the brightness of a 
light, pounds per square inch to measure the intensity of pressure of a touch, 
decibels to measure the loudness of a tone, volts and amperes to measure the 
intensity of a shock, and wavelength to measure the hue of a light. It is clear 
that some stimuli are harder to measure than others, say, rumblings from a 
Stomach, If pushed, though, we can even measure the number and strength 
Of stomach rumblings. When we move away from physical dimensions the 
method of measurement changes. We can easily measure the size of a non- 
Sense syllable, but what about its meaningfulness? As we pointed out in 
Chapter 1, we estimate this by the number of words or ideas the syllables 
Suggest to the judges. If we specify carefully the conditions of the judgments, 
such as the instructions given to the judges, we have a useful definition of the 
Meaningfulness of nonsense syllables. Indeed, we would specify all these Fi, 


determinants of the measure of meaningfulness to promote clarity of com- language 
and Methods 
of Learning 
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munication. Since we clearly specify the operations involved, this type of defi- 
nition is called an operational definition. We could define the meaningfulness 
of a nonsense syllable in nonoperational terms—for instance, the feeling of 
“wordness” that the nonsense syllable conveys. But since this statement does 
not tell us how to go out and measure or observe meaningfulness, it is not an 
operational definition. In a sense, once we have operationally defined meaning- 
fulness, future usage of the word is often only an abbreviated way of restating 
the operations of measurement. The major purpose of operational definitions is 
to promote clarity of communication. 

This important function of operational definitions is clearly brought out 
by a consideration of another type of variable that usually precedes per- 
formance—motivation. If we were content to describe our experimental sub- 
jects as simply highly motivated, or very hungry, or quite desirous, our 
communication would not be precise. But we can operationally define a very 
hungry rat as one that has been starved for a specified number of hours after 
having been permitted to eat his fill. 


The Performance Itself 
The second stage we call 
. the response. A response can be as complex as trying to rub your stomach in 
a circular motion with your left hand while patting your head with your right, 
or as simple as a twitch of a muscle in your forehead. Responses can come in 
any sizes but when they get to be highly complex, such as turning on lights, 
closing the shades, and turning up the heat, we usually call them acts. 
Like stimuli, responses can be relatively overt (screaming at the top of your 
lungs) or relatively covert (sweating). Both of these responses are measurable. 
We measure the loudness of the scream in decibels. We measure the amount of 
sweating by passing a small and undetectable electric current through the skin; 
when a person sweats the current passes through the skin more easily. This 
change in current flow, which can be detected by instruments, is called the 
galvanic skin response, GSR (or sometimes the psycho-galvanic response, 
PGR). 

A response almost inevitably becomes a stimulus. If you respond to a 
stimulus with fear, you may sense your heart rate increasing, your blood 
pressure rising, your extremities getting cold and sweaty, and your breathing 
growing shallow. If you pay attention when you turn this page you will notice 
that your arm movements produce proprioceptive stimuli. The fear and the 
arm movements are responses that produce stimuli, hence the term response- 
produced stimuli. Furthermore, we can learn responses to response-produced 
stimuli. A good example is the rat in the May study that learned to jump 
the barrier when he sensed the internal stimuli produced by the fear re- 


sponse to the buzzer. 
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If methods already exist, such as for meaningfulness of syllables or for 
loudness of tones, the measurement of stimuli in a laboratory is usually 
not difficult, since the experimenter is the one who originates the buzzer or the 
shock, He knows what is coming and can either measure it beforehand or 
prearrange conditions so that he records or measures it during the experiment. 
But problems of measurement occur even with stimuli. Take the case of 
operant conditioning of the mental patient by the college student. The latter 
did not know what stimuli preceded the response he was conditioning; he 
simply waited for the response and then reinforced it. It is clear that in some 
kinds of learning research the stimuli will be difficult (some think unneces- 
Sary) to specify. 

But we almost always must measure the response. We 
in the T-maze and look to see whether the animal learns to run to the island 
of safety in the left arm of the maze. If our point is, say, to detect the differ- 
ence in effect of two levels of shock, we must measure the response as pre- 
cisely as possible in order to know what effects different levels of shock have 
had. There are several major types of measurement available. The simplest 
Measure is merely a count of the number of times the “correct” response 
(turning left in the T-maze and reaching the island of safety) occurs in a 
given number of trials. Thus, we can Say that under shock level A a rat made 
the correct response in eight of ten trials; under shock level B he made the 
three out of ten trials. This measure is called the 
the amount of time it takes a 


turn on the shock 


€ wa 


oL a Gh 


ipBued saM “LY TO'S 


Correct response in only 
Jrequency of response. We can also measure 
response to get underway. We could put an electric-eve device at the exit of 
the Starting box and wire a clock to turn on when the electric shock begins 
and stop when the rat, in leaving the starting box, interrupts the photo-electric 
beam. We call this measure the latency of response. In addition, we could have 
another clock wired to start with the electric shock and to stop when the rat 
Teaches the island of safety. This would record speed of response, or response 
time. On some trials the rat may turn right instead of left; this would be an 
error, We can also measure the percentage of mistakes that occur. The per- 
Centage of correct responses and the percentage of errors give you the same 


ir ait 
formation except when the rat does not 
An experimenter once harn 


force of the rats’ pull. He then 


E ON “OD 


cent 
leave the starting box. We also want 
to know how “large” a response is. essed rats to 
at measured the 
d the resultant differences in strength 


aze. This measure is called the 


a pulley-and-spring device th 
Varied the rats’ motivation and measure 
Of pull as each rat left the starting box of the m 
amplitude of the response. After conditioning we SO! 
how strong the conditioned response is. In the case of the planarian we could 

Continue to present the light but omit the electric shock; the strength of the lace 
Conditioned habit would be reflected by the number of trials on which the guage 


animal continues to respond to the light_alone. and Methods 
te of Learning 


metimes wish to know 
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In operant conditioning we often measure the rate of response. As the col- 
lege student reinforced the mental patient with candy for facing the door to the 


; in the second hour “a little 
he faced it “almost all the time.” 
e increased. The rate of response 
ant conditioning situations. Since 
d to say when a trial begins; it is 


r P 7 Operationally defined, a 
ewan 1s an event that Immediately follows a response and increases the 
likelihood of that response. Here is a 


Figure 2-2, This rat, 
with an electrode im- 
blanted in his brain, has 
been placed in a Skinner 
box where his bar-press- 
ing responses can be ma- 
nipulated by electrical 
stimulation of the “pleas- 
ure” center of the brain. 


(Courtesy of Dr, James 
Olds.) 


With animals the rewards in experiments are usually chosen to reduce some 
physiological need. A male rat completing a maze finds, depending on what he 
has been deprived of, a receptive female, or some food, or some water, or 
escape from an electric shock. The Coppock and Chambers rat turns his head 
to the right and has some sugar solution injected into his caudal vein. 

In the course of investigating the effect of direct electrical stimulation 
of the brain upon a rat’s behavior, James F. Olds and Peter Milner acci- 
dentally discovered a novel way to deliver a reward. The electrical stimulation 
Is provided by a minute electrode implanted in the brain (Figure 2-2). One 
day, unknown to the experimenters, the placement of the electrode in one 
historic rat was slightly off target. The experimenters noted that when the 
vat was placed in an open field and stimulated (there is no pain at all asso- 
ciated with such stimulation), he tended to return repeatedly to the spot 


where he had been stimulated. 


Ta More stimulation at that place caused him to spend more of his time there. 
ater we found that this same animal could be pulled to any spot in the maze by 
giving a small electrical stimulus after each response in the right direction. This was 
akin to playing the hot and cold game with a child. Each correct response brought 
electrical pulses which seemed to indicate to the animal that it was on the right track. 
e rom J. Olds and P. Milner. Positive reinforcement produced by electrical stimula- 
tion of septal area and other regions of rat brain. J. comp. physiol. Psychol., 1954, 
47, 419-427.) 

as a place in the brain 
n any case, after stimulation, 


hich is our definition of a re- 


In effect, what Olds and Milner had discovered w 


that acted as a “pleasure,” or reward, center. I 
the preceding response increased in likelihood, W. 
ward. They tested further and found that even if starved the animal would 
Pass up food in order to receive electrical stimulation. The rat learned to run 
In a T-maze to receive the stimulation. When the rat was killed and its brain 
microscopically examined, it was found that the electrode was in a portion of 


the brain called the anterior commissure. In subsequent research, the in- 
Vestigators have discovered that only very circumscribed areas of the brain 
Produce a “reward” effect. Some areas are quite neutral; some areas produce 
a “punishment” effect, Research on these matters is in its early stages, but 


even now it is exceptionally exciting for it promises to help us understand the 


me i 
chanism of the reward effect. 


e emphasized animal research. This 
] learning the rewards are tangible 
d in the case of a college student 


t In our discussion of rewards we hav 
Str ë r N n é 
ess is quite reasonable, since in anima 
an * y r 

i d easily identified. But what is the rewar s ; 
earning a list of nonsense syllables? Those psychologists who judge reinforce- 
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ment to be necessary for learning suggest that when the college student suc- 
ceeds in learning successive parts of the nonsense syllable list, he is rewarded 
because he is mastering a task. Although this explanation is not unreasonable, 
it is not satisfactory, since there is no way to observe the reward directly. 


Sensory Preconditioning 

A second explanation is 
more parsimonious. It grows from a theory that rewards are not necessary 
for learning. In this view, all that is necessary for learning is that a stimulus 
and a response occur at approximately the same time; this association is called 
temporal contiguity, or just contiguity. The stimulus will then have the power 
to evoke that response. There is a type of conditioning experiment called 
sensory preconditioning in which such learning has been demonstrated. 

Two stimuli, such as a light and a tone, are presented together (contigu- 
ously) for a number of trials. One of these, say the tone, is then used as a 
training stimulus and is paired with meat powder blown into a dog’s mouth. 
The meat powder automatically causes saliva to flow. After a number of 
pairings, the tone alone will produce a salivary response. After this initial 
training, the second stimulus, the light, is presented. Sensory preconditioning is 
said to occur if the salivation now occurs in response to the light. The first 
demonstration of sensory preconditioning was provided by W.J. Brogden, 
who felt his experiments proved unreinforced learning to be possible. 

The mechanism of this learning has been explained in terms of mediation 
a process we first met in Chapter 1 in the context of verbal learning. W. 
tone and light are presented together, the dog attends to them, 
he may turn his head to the light and prick up his ears to the tone, It is 
possible that in the first stage a connection is established between the stimu- 
lus of the light and the dog’s response to the tone. 


, 
hen the 


For example, 


1. light > pricking up ears (to tone) 


In the second stage the tone is presented with the meat powder and be- 
comes a stimulus for the salivary response. When the tone sounds the dog 
pricks up his ears as usual. This response produces proprioceptive stimuli 
that impinge on the dog at the same time the meat powder is blown into his 
mouth, Consequently these proprioceptiv: 


e stimuli also become stimuli ca- 
pable of eliciting the conditioned saliv 


ary response. 
2. tone > pricking up of ears > proprioceptive stimuli 


meat powder — salivation 


e Now when the light is presented in the third stage it should elicit the 


Language Yesponse of pricking up of the ears (learned in the first Stage). This response 
and Methods will produce Proprioceptive stimuli. Since in stage two these proprioceptive 
of Learning 
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stimuli became stimuli for the salivary response, that response should occur 
now too. 


3. A. light > pricking up of ears 
B. pricking up of ears —> proprioceptive stimuli 
C. proprioceptive stimuli > salivation 


Notice that in this explanation the association between the light stimulus 
and the response of pricking up of ears is learned as a function of the con- 
tiguity of the stimulus and the response without any apparent reward. 


Designing and Conducting an Experiment 
on Contiguity Learning 


Although this is a reason- 

able explanation of this experiment, it possesses the same fault as the “task- 
mastery” reinforcement explanation of the college student learning a list of 
syllables. It depends heavily on events that have not been observed. To 
Overcome this limitation, Brogden decided to attempt to condition an overt 
response to an overt stimulus without the aid of reinforcement simply by 
having them occur contiguously. His stimulus was a 1000-cycle tone of 
moderate intensity; his response was cage rotation (see Figure 2-4). His 
Subjects were 23 kittens, 60 days old. The kittens came from six different 
litters, each of which was divided as equally as possible into the experimental 
(11 kittens) and control groups (12 kittens). In this way, anything unusual 
about a litter would affect the control and experimental groups equally, and 
consequently any future differences between these groups could not be 
ascribed to litter differences. Before beginning conditioning, Brogden made 
sure that his tone did not evoke the cage-turning response. Findi 
did not, he started conditioning the experimental group. In conditioning 
he presented the tone at the same time as the kittens made the cage-turning 
response. He waited for the response to occur; as soon as it did he turned the 
The response and the tone had now been paired 
group had 30 such trials, 
ng, sounding the tone for 


ng that it 


tone on for four seconds. 
Contiguously. After each kitten in the experimental 
he ran 20 trials testing for the effects of conditionir 
four seconds when the kittens were quiet and watching for a conditioned 
Cage-turning response. A conditioned response was tabulated if ee kitten made 
a cage-turning response while the tone was on. His 11 experimental kittens 
made a total of 38 cage-turning responses. In order to decide whether con- 
ditioning had taken place he needed his control group for comparison pur- 
Poses. How did he treat the control group? He went through exactly the same 
Procedure as for the experimental group; but he allowed the control kittens 
to make the 30 cage-turning responses without any presentation of the tone. 
When he tested them with 20 presentations of the test tone, the 12 control 
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Figure 2-3, Rotator 
conditioning apparatus 
used in the study of 
contiguous conditioning, 


(Courtesy W. J, Brog- 
den.) 


kittens made a total of only seven cage-turning responses, T 
y had made over five times as many (38). This clearly in 
group nt contiguous occurrence of the tone and the response had been suffi- 
ee establish an association between them. S 
Apparently all that is necessary for an association to develop between 
ts lus and a response is that they occur together frequently, Rew 
Sue be necessary. When reward is used, however, conditio 
not oe. rapidly and with greater vigor, But in conditioni 
Amie neutral stimulus is almost alw. 


he experimental 
dicated that the 


a 
ard does 


ning pro- 


ays presented before th 


to the planarian serve 
of signal that the shock was coming. It is in the nature of Brogden’ 
g 


ing the conditioning phase the tone was always sòu 
that Sn This sort of time relationship is called back 
response A s 


© response 
occurs. Thus, the light preceding the shock oo 
S technique 
ust after the 
ward Conditioning, 
ective conditioning 
tioning in this x- 
3 is due to this inverted stimulus-response sequence, 

E O has introduced you to the methods, language 


ded j 


hall see in the next chapter this is one of the least eff 

es ; E f 

K lures. Perhaps the weak effect of contiguity condi 
procedures. 


» and thinking of 
hers in the field of learning. We are A awed for a detaileq examina- 
c ; ildi y : 
cay one of the important, simple building blocks of learning, “onditioning 
tion 0 g. 
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Simple Learning: 
Classical and Operant 


Conditioning Most organisms, even hu- 


man beings, have responses that will be elicited automati- 


cally by certain stimuli without any previous learning. 


Shine a light into the pupil of the eye, or bite into a 


hamburger and in both cases predictable responses oc- 


cur. In the former case, the pupil contracts, in the 


latter, saliva flows in the mouth. Such unlearned re- 


sponses to stimuli are called reflexes; their common prop- 


erty is that they occur without any prior learning. 


Pavlov made extensive use of the salivary reflex in his 


pioneering study of the simplest kind of learning: the 
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establishment of a new connection between a stimulus and a response. 
In the course of a series of studies on gastric secretions in dogs, he ob- 
served that the sound of the approaching footsteps of the dogs’ keeper was 
sufficient to produce the flow of saliva. What was remarkable was that the 
dogs salivated even though the food had not yet been put into their mouths. 
Pavlov decided to make a systematic study of this reaction, which he called 
a “psychic secretion.” Rather than continue to work with the footsteps of the 
keeper as a stimulus to evoke psychic secretions, Pavlov turned to more easily 
produced and controlled stimuli, Thus, he trained the dogs to salivate to a 
tuning fork rather than to footsteps. The basic procedure he used is called 
classical conditioning: it is already familiar to us since we described the clas- 
sical conditioning of the planarian in Chapter 1. 


The Basic Experiment 


Before the experiment 
began, each dog underwent a simple operation to expose the duct o 


gland. This enabled Pavlov to measure responses by the number 
saliva secreted. The first step in the experiment was to sound 
fork alone to be sure that it didn’t elicit salivatio; 
usually elicited was a turning of the head anda 
this possibility was eliminated, the sound of a tuning fork was presented to 


a dog at about the same time that meat Powder was blown into his mouth 
This pairing of meat powder and sound was r 


f a salivary 
of drops of 
the tuning 
n before training. (All it 
cocking of the ears.) After 


peated a number of times. 
Then Pavlov ran a test trial; he Presented the sound of the tuning fork with- 
out the meat powder, and waited to see whether Salivation would occur. It did. 
He also found that the more often the sound had been Paired with the meat 
powder, the more the dog salivated to the sou 

number of drops of saliva produced as a functi 


nd alone. Table 2 shows the 
on of the number of pairings. 


Figure 3-1, 
experimental 
ment. (From D: 
Scientific principles of 
Psychology, Englewood 


Clifs, N Te A 
Hal, ki fi Prentice- 


Pavlov’s 
arrange- 
J. Lewis, 


Development of a Conditioned 
Salivary Response in One Dog 


Number of Presentations Drops of Saliva 
of Tuning Fork and Meat Powder in 30 Seconds to Tuning Forks Alone 
1 o 
9 18 
15 30 
31 65 
41 64 
51 69 


Taken from G.V. Anrep, J. of Physiol., 1920. 


The Language of Conditioning 


Because Pavlov did so 
much of the original work in this area, it was he who coined the technical 


words to describe the procedure. He called the stimulus-response (S-R) con- 
nection acquired through this procedure the conditional reflex; by this he 
meant that the reflex was not innate but conditional on previous training. 
Somehow in the course of the translation of Pavlov’s major book into English, 
the term conditional was improperly rendered as conditioned, and to the 
present day such an S-R connection is called a conditioned reflex, or, more 
generally, a conditioned response (CR). Pavlov called the meat powder an 
unconditional stimulus, and the reflexive salivation an unconditional response. 
A similar error in translation produced the current terms unconditioned 
stimulus (UCS) and unconditioned response (UCR). Pavlov called the tone 
the conditional stimulus—now, more usually, we say the conditioned stimulus 
(CS). The total procedure, called conditioning, is presented diagrammatically 
in Figure 3-2, 

It is probably worthwhile to rev 
them extensively throughout the rest of the book: 


iew these abbreviations for we shall use 


). In the Figure it was the tuning fork, which 
der which was the 
a stimulus that can elicit a reflex 


CS (conditioned stimulus 
served as a signal for the meat pow 
UCS (unconditioned stimulus). This is 
response, salivation, termed the 
UCR (unconditioned response). In con 
tached to the CS and is then called 
CR (conditioned response). 


ditioning this response becomes at- 
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Before Training 


1. Tuning fork (CS) —_ (Head turning, cocking of ears) 


Training 
2. Tuning fork (CS) and 
meat powder (UCS) a> eSalivation (UCR) 


After Training 


3. Tuning fork (CS) —_——- Salivation (CR) 


Figure 3-2. A schematic diagram of the procedure for conditioning. 


irings of the cs (sound) and the 
omeo ER (salivation) evoked by the CS 


literature in Conditioning. We shall examine 
se writings, 


UCS (meat powder) and the a 
alone. There is a vast research 
four questions considered in the: 


1. What types of reflex responses may vi 
of a stimulus? Specifically, can a REEN ae Conditiona 
as a UCS? S such 
2. Will similar stimuli eli 
tioned a salivary response to 
dog also generalize this respo; 
he salivate as much to a tuni 


l to the presentation 
as an electric shock serve 
cit the 

a tuning fork of mse? If we have effectively condi- 
nse to the sound cycles per Second (cps) will a 


o A Klah 
: tuning fork of 1499 ee tuning fork of 1200 cps? Will 
3. What is the best time intery: i 


al between the 
the UCS? Onset of t 


7 more complex units? 
Noxious Stimulus as a UCS 
T In h; 
almost always made use of a positive UCS sth as ae research, Pavlov 
Russian contemporary of Pavlov, initiateq the aa W. von Bechterev, a 
noxious stimulus, as a UCS. In Bechterey’s bas; x of electric shock, a 


ic 
a dog on his left rear paw (CS). An electric shock a 
to the right front paw (UCS), at which point the og Mien be Anieri 
spond by flexing that paw (UCR). After a number u ulq automatically ie 
UCS, the CS would be presented alone anq a pai 


flexion o irings of CS and 
(CR) would occur. Clearly, Bechterev haq €stablisheq i Seat front paw 
nis- 


connection 


30 


between the touch on the left rear paw (CS) and flexion of the right front 
paw (CR). Notice that the dog did not avoid the shock by flexing his paw. 
Experimenters have also studied the effect of a CR that enables a subject to 
escape a shock. In this situation, it turns out, conditioning proceeds much 
more rapidly. 

In a classic study, W.J. Brogden, E.A. Lipman, and Elmer Culler put two 
groups of four guinea pigs each in a rotating wire drum (squirrel cage). For 
both these groups (individually trained and tested), a tone (CS) was sounded 
followed by an electric shock (UCS), which caused the animals to run in the 
rotating cage (UCR). For one group, however, regardless of what they did, 
the shock was not turned off. After a number of such conditioning trials, 
according to the authors, the animals behaved as follows: “When the tone 
began, they [the guinea pigs] ‘sat tight,’ held their breath, and tensely 
awaited the shock.” Some of the animals never learned to run (CR) to the 
Sound of the tone. They all seemed to have learned to fear it. 

In contrast the Second group of guinea pigs, subjected to the same proz 
cedure, could turn off the shock if they succeeded in turning the rotating 
cage by running (UCR). Figure 3-3 shows in percentages how many animals 
in both groups learned the CR (running) to the sound of the tone. 3 

The results show that in the early portion of the experiment bat groups 
ran (CR) to the same extent when the tone was sounded. Those in the group 
that could avoid the shock continued to learn so that in eight days they were 
running 100 per cent of the time in response to the cs. In thie group that 
could not avoid the shock, however, running did hot increase in i as 
the experiment progressed. These animals, though, did learn an emotional re- 
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action—fear—to the sound of the tone, as is evidenced by their crouching and 
breath-holding. This experiment has some of the properties of operant condi- 
tioning, which will be discussed below. It indicates that a negative stimulus, 
such as shock, may be used as a UCS to produce a conditioned response. If 


è A 3 a e 
an animal's overt response serves to avoid the shock, then he learns th 
response more easily. 


The Learning of Fear. 


ditioning of fear was reported by 


served as the subject, Initially, Albert wee 
first seeing only aroused the child's curi- 
osity. After Albert had had a chance to examine the rat, the animal was re- 
moved from his sight. Then the rat Was presented again, and at the same time 
noise (the pounding of a steel bar with 
a hammer) behind Albert. This noi 


make Albert cry, 
If we substitute the Pavlovian 


the harsh noise, and UCR (and la 
model of how 


terminology 


fear throug! 
“Can a nega 


0 produce ą conditioned response?” We may 


© to avoid a noxious UCS then 


Stimulus Generalization, The troubles o 
end when the white rat was removed from is sight it pense 
sight of the white rat frighten him, but Other ‘ 


objesi PW, not only did the 
: Š ect A 
a rabbit, or a white mask, also frightened him R * Such as a ball of cotton, oF 


f poor little A] 


object that did not resemble the white rat ie jira, not frightened by any 

by objects that were similar to it in some way ( os of wood), but He was 

the sake of continuity, we shall leave Albert in me white and fuzzy). For 

alleviated a few pages ahead. IS state ð fear: it will bè 
Such a response, based on stimulus similarity s 

tion. As in the case of Albert, we fing that aik all 


ea ed Stimulus generaliza- 
E Ps F RA Tes m h 
stimulus, similar stimuli can also elicit the TesDonse oie 1S trained to a 
: -In 


Very strict sense, 


S o a Pra us since we never experience the same stimulus 
3 y more than just once. Each time we walk down the 
street and enter the correct door to our residence our retina is doubtless 
stimulated in a different manner. This may be due to changes in light levels 
because of weather, time of day, or whether or not we are wearing sunglasses. 
It may be due to the exact angle at which we enter the street and approach 
our residence. In any case we are responding to a “new” stimulus which is 
similar to the stimulus situation in which we le 
ing condition for stimulus generalization. 
; Generalization is an extremely importa 
it quite extensively to help explain other a 
been called on to help explain aspects © 
behavior of various cultures, the Rorschach test, and psychotherapy, among 


o ; : ; 
ther things. For this reason a great deal of research has been undertaken in 
Many investigators have centered 


arned our response—our defin- 


nt phenomenon; psychologists use 
nd more complex behavior. It has 
f the behavior of schizophrenics, 


or F apes A 
het to describe generalization precisely. 
eir attention on specifying the changes in response that result from varying 


the similarity of a test stimulus to a CS. The initial step in these studies has 
been to determine stimulus similarity. The most straightforward manner of 
doing so is to measure the closeness of stimuli on some physical scale. Thus, 


the hue orange is closer to red than green is; the note A is closer to B than E 
s more like grade 01 than grade 09 is; the 


n the ankle is. Generalized responses based 
arity are called primary stimulus generali- 
d primary stimulus generalization in 
f their physical similarity to the 


is; among sandpapers, grade 00 i 
back is closer to the shoulder tha 
on such measurable physical simil 
zations, Our little friend Albert exhibite 
responding to test stimuli on the basis 0 
Original trained CS. 

Most research on generalization uses a 
Pavlov, using a vibration applied to the shoul 
as a UCS, found the spatial pattern of genera 


much more exacting measure. 
der of a dog as a CS and food 
lization presented in Table 3. 


Spatial Pattern of Stimulus Generalization in Dogs 
Number of Drops of Saliva 
in 30 Seconds 


Place Stimulated 


Front paw 
Shoulder (CS) 
Side near shoulder 
Side near thigh 
Thigh 

Hind paw 


Oow 


o 


From I.P. Pavlov, Conditioned reflexes (trans- by G.V. Anrep). London: Oxford Univ. 


Press, 1927- 
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Distance in inches of Points stimulated from left sation obtained by Bass 
shoulder (CS) 


and Hull. (From M. Bass 
and C.L. Hull, J. comp: 
Psychol., 1934.) 
The salivary response was the UCR and the CR. As the physical location of 
a test stimulus becomes more distant fi e 7 
rom the locati iginal CS, the 
strength of the CR decreases. tion of the original CS, 


; as we sweat the 
IS decrease in skin resistance 
» SO it has fr d 
” i equently been measure 
tudy (as in Bas q y been 


for generalization by applying vibratory stimuli to ho ditioning they tested 
back, left thigh, and left calf, each point exact e small of the student's 


2 ited by each of inches from the one 
in Figure 3-4. This curve is called the gradi 


ent of eis. © cations is:shown 
Í stimulus 8eneralization 


nearest it. The amount of response elic 


Stimulus Generalization and the Displacement of Emotj 
- an A ion, 
pity to leave this description of stimulus n 
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complex behavior, Let 
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us examine Nez alani 
sit E ra of displacement. Displacement is the name 
LS e B > a boy who goes home and shouts at his little sister 
TOORA pyr i a a ere scolding by his teacher at school. It consists of 
dikaler, Pie ee rom an original target to one that is more available 
Pdisplacemnent = turns and kicks the dog, we have another example 
a aa : ra snes is a concept that has seen wide use in the study 
suediar H te ee ps described by Sigmund Freud. As a subject for this 
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lite ad We ater reactions to men are in some d 
d se men to her father. This reaction on the basis of similarity is an 
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more complex figures that follow. The men in Figure 3-5 V 


of their si 
eir ilari x g aden ; 
similarity to the father. As a dimension of similarity we have arbi- 
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F A would she pick? To begin with, thoughts relating to the father’s 
tone acy would be accompanied by massive anxiety because of our civiliza- 
of M pewerfil incest taboos. Would her choice then be Man 1? Well, because 

Man 1's great similarity to the father, he shares, through generalization, 
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eralization gradients of 
fear and hostility. 


This sort of similarity is based on learning. Responses based on learned 


Similarity are termed secondary generalization. 
, Gregory Razran attempted to study secondary generalization of salivation 
în human beings. He sat college students before a table laden with salty tid- 
bits and asked them to munch away while words were being flashed on a 
screen. He assumed that the words would become CS’s while the tidbits were 
UCS’s—that is, in response to these UCS’s and in the presence of the words, 
the students would salivate. Afterwards he tested to see whether conditioning 
had occurred by inserting wads of dental cotton into the students’ mouths 
while the CS words and other, neutral words were exposed. The wads mar were 
in the subjects’ mouths while the CS’s were flashed, turned out to weigh more 
than the others, thus indicating salivary conditioning. Razran also noted that 
when he tested with synonyms of the CS’s he co 


uld detect a degree of saliva- 
tion indicative of secondary generalization. 


Discrimination 


Although generalization is 

Of great help to people, unless it is contr 

the case of the new lieutenant in the army 

tain,” to the major. Although the uni a i 

erences that the new lieutenant must learn to dis- 
e been carefully studied. The 


discrimination havı 
place in Pavlov’s laboratory. It happened 


olled it can lead into difficulties. Take 
who says, “Good morning, Cap- 
form of a captain and major are similar, 
there are important diff 
tinguish. The bases of such 
first systematic investigations took 


this way 
Pavlov found that he could use almost any stimulus as a CS. He even 


trained a dog to salivate to a metronome ticking at 10a beats per minute. 
As we might expect from our knowledge of generalization, th dog also sali- 
vated to S0 ficats per minute. Then Pavlov continued to deliver meat powder 


with the 100-beat CS, but not with the 80-beat stimulus. After giving a few 

responses to the 80-beat stimulus, the dog stopped; but he did continue to 
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respond to the 100-beat one. The dog 
the 80 beats. In further training the 10 
meat powder, but in the trial withou 


had discriminated the 100 beats from 
0-beat ticking was always followed by 
t meat powder Pavloy shifted to an 
85-beat stimulus. After a few trials the dog again salivated only to the 100- 
beat sound. The dog’s discrimination was then further tested by moving up 
to 90 beats and finally to 96 beats. Even with so small a difference as four 
beats per minute, the dog was still able to distinguish between the two rates. 


Experimental Neurosis, 


If the discrimination demanded became too fine, 
the dog semed to have a “ 


nervous breakdown,” or what Pavlov called experi- 


escribes how he trained dogs to discriminate a circle 
from an ellipse. The circle was alw 


powder). The ratio between the hori 
began at 2:1, 


encountered a sharp air blast 


in this regard is a book by John Dollard and Neal Min 
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Psychotherapy. ersonality an 


The Fate of the Conditioned Response 


Extinction of the Conditioned Response. When the Ae he a a 
criminate, he withheld responses save for the 100-beat stius Ps i 
- Pavlov 


effected this suppression of response by omitting the UCS when stimuli other 
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After a number of presentations 
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lieved that th Any rather that they were inhibited by other ie Se 
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to this sudden Sae he gave the name disinhibition, or inhibition of inhibition 
phenomena ie in the strength of a CR undergoing extinction. Through the 

spontaneous recovery Pavlov found further evidence for the 


claim 
that the CR was not totally unlearned during extinction. If a period 
al after supposedly complete extinction, the 
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eh again appear without further training. Rurthesno™s the strength 
tinction, I after the rest would be almost as great as its strength before ex- 
Spontane f the animal is continually put through the cycle of extinction and 
less at eous recovery, the spontaneous recovery that occurs becomes less and 
at each cycle, Eventually the response will not recover at all. 
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Stimulus intervals in seconds 


CS-UCS inter- 


veness of different 
1947, 60, 327.) 


Figu > 
Ke a310: Comparison of the effecti 
J- Psychol., 


vals, (F 
S. (From A, Spooner and W.N. Kellogg, Amer. 


On, : 
a of the CS. The lower line of the pair indicates the UCS and here too a 
a indicates the onset of the UCS. A drop in a line indicates the termination 
Ean stimulus. 
fia 
Which of these experimental s 


As ‘ 
“ you might expect, the simultaneous CO bs 
Surprising, exact simultaneity of CS and UCS is not best. Virtually all 


Investigators have reported that a delay of about half a second between the 
onset of the CS and the onset of the UCS produces the fastest learning. On 
either side of this interval conditioning nore slowly. In an early 
Experiment on these time relations, Helen M. Wolfle found that having the 
CS precede the UCS by .5 second was best. The most complete study on this 
topic was that of A. Spooner and W.M. Kellogg, who worked with the fol- 
lowing five temporal intervals between CS and UCS: iea, —-25 Se. S 
Sec., +1.0 sec., and +1 5 sec. (the negative numbers indicate backward condi- 
tioning when the UCS preceded the CS). In Figure 3-10 we see a composite 
Of the results of Wolfle and of ellogg. Again we see that the 
optimal interval between the CS and U pout +.5 sec. This persistent 
and specific time relation, intriguing aS i as thus far eluded complete 


easiest learning of a CR? 


et-ups leads to the 
the best, but, what might 


ndition is 


Spooner and K 
CS is a 
t is, hi 


explanation. 
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Higher-order Conditioning 
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er-order conditioning has not been noe 

er. Perhaps the electric shock produces 
that becomes a stimulus capable of eliciting withdrawal of the paw. If so, } 
is then possible that the fear Tesponse was being conditioned to each of the 


: ae 
Partially responsible for the success of this 1 


stance of higher-order Conditioning, 


The Conditioning of Meaning, an Instance of Hi 
recent adaptation of higher- 


“bad.” In this case the word bad 
is the CS, punishment is the UES 


è » and some emotional response such as 
“feeling unpleasant” is the CR. After of pairings of bad with punish- 


ment, bad itself should begin to arou oned unpleasant feelings in the 
absence of physical punishment. ild is told that “dirt is bad,” on 


res, the word dirt takes on some 


a number 
Se conditi 


of bad’s unpleasant feelings. 

This is a plausible hypothesis: some re 
indeed acquire meanings in much this w. 
Carolyn Staats has shown that if you pai 
with a group of unpleasant words such as baq 
takes on unattractive overtones: if You pair it y 


With w 
and sweet, it comes to be rated as Pleasant. 4 
£ , 


cent work has 
ay. One ex) 
Ta nonsen; 


shown that we may 
periment by Arthur and 
Se syllable such as WEM 
» Mean, and Sour, the syllable 


Ords such as love, peace, 


though work 


still in its infancy, it shows promise of Provi 


i viding a partial 
problem of how words and objects acquire their emotion, 


of this type is 
answer to the 
al significance. 
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Th . r 
Pie pend se sasha room in a mental hospital. A seriously disturbed 
says almost gers e is mental status with a psychdlogist: The psychologist 
sional approving ri ih feponse to the patient's remarks except for an occa- 
reinforcements oe or understanding “uh-huh, responses meant to be 
opinion, such a e does so only when the patient makes a statement of 
is the result of thi feel that . . -,” or “Tt is my Soe that... - What 
Pisoni discov this procedure? Experimenters Kurt Salzinger and Stephanie 
approval ar a that the reinforcement provided by such statements of social 
made by a ective in greatly increasing the number of opinion statements 
sion of he ann (Although the point is not directly relevant to our discus- 
More easily ioning, it is of incidental interest that the patients who condition 
they arë oe HEGOVED from their illness more quickly. Perhaps this is because 
Sillar re Sensieive! to the reinforcement provided by such social approval.) 
experiments have been conducted with normal persons. In one 
to He esperimenta instructs a subject to call out any word that comes 
selected. Whenever the subject calls out & word that belongs to ji arbitrarily 
respond Category such as plural nouns oF two-syllable words, the experimenter 
Of Fe S with an encouragement suc h.” A record of the occurrence 
of wins co in the preselected category as a function of time (say, number 
rate of ReUDS in successive one-minute periods) will typically show that the 
tinues gin of these responses increases markedly m the D con- 
becom, his conditioning can occur apparently even if the subject does not 
e aware of the rationale of the procedure. If he is aware, conditioning 
ec more rapidly. Some recent data suggest ra a se th 
iiie interview discloses that all subjects who condition 
ee of the experimental contingencies. . f mm i 
Sk e essential elements here are @ response that 1s eee ah e to the 
het (plural nouns) and a stimulus (uh-huh) that is effective is increasing 
rength of that response. The response 1S called an operant response (it 
Operates to bring about the reinforcement), ning stimulus is 
called a reinforcer, and the general procedure is ©@ 
As we saw earlier, this is the type of conditioning th: 
bring the mental patient to the basement experi 
Perhaps the most well-known apparatus used for OP 
a small, sometimes airconditioned, sometimes soundproofed, box that contains 
a little lever, & food cup, and perhaps & light. This apparatus is called a 


for 


has “uh-hu 


the strengthe 
lled operant conditioning. 


at enabled the student to 
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“Boy, have | got this ay 
conditioned! Every time 
press the bar down he drops 
in a piece of food.” 


Figure 3-11. A typical 
Skinner Box? (Adapted, 
by permission, from 
Jester, Columbia Univer- 
sity.) 


). Typically the lever 
n. This pen rests and 

l x i rring 
the pen simply draws a horizontal ]j hen no response is occurring 
response, the pen makes a ‘nak 


Figure 3-12. A typical cum i: 
ulative re 
first four responses. A and B denote Ve Sraph showing a record of the 
tence, rate—of responses. 


Response 4 


Response 3 


Response 2 


Cumulative number of responses 


Animal X 


. 
5 
a pe 
E c] 
: 2 
23 2 
58 ge r 
5% c= 5 Animal Y 
Eo 22. 
SE 33 
O's ERE 
7 (om 
ime roe Time —> 
Fig 
ure 3-13 
ia A comparison of the response rates oj two rats pushing u 


lever for food. 


the t 
otal cu j 
m i ; 
axis) pres ulative number of responses whereas the abscissa (horizontal 
ent: ; . 5 . 
s a continuous record of time. There are four responses on this 


Era 
in is indicated by an upward deflection. The graph shows 
than the Gen, or one, obviously the time between responses 3 and 4 is less 
slope betyy e between responses 1 and 2. For another, the steepness of the 
labeled i és any two points tells the rate of response. Here, the solid line 
labeled B times the slope between responses 1 and 2, the dotted line 
B is stee enotes the slope between responses 3 and 4. Since the slope of line 
per than the slope of line A, the rate of response between 3 and 4 is 


fas 
ie the rate between 1 and 2. 
with — to compare differences i 
Figure ret anion steeper the slop : 
respons we see graphs for two rats pushing 
LEEREN rate is considerably faster than animal i is sho 
slope of X’s curve. Such a difference might result if Xi 


than Y, 


response rate for different animals 


r the response rate. In 
a lever for food. Animal X’s 
y’s rate as is shown by the 
s hungrier 


n 
e the faste 


Schedules of Reinforcement 


to fisherman does not 
a fish with every cast of the line; the crop the farmer sows does not 
always yield a harvest.” And the rat does not get a pellet eve 
always occur 100 per cent of the 
e once for every other 
en once for every 50 responses. 


e such situations. When the 


ry time he 


Presses the lever—reinforcement does not 


ften only reinforce 


time, The operant conditioner will o 
ten responses, OT ev 


response, or once for every 
ment to indicat 


We use the term partial reinforce 


cement is regular (say, once every ten responses), we call it 


partial reinfor 
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ratio reinforcement. Interesting results occur when the partial reinforcement 
is keyed to time. Jnterval reinforcement, as this is called, does not depend on 
the number of responses made; an experimenter simply reinforces one re- 
sponse in a time period (for example, one response every minute). No matter 
how many responses are made only the first one will be reinforced in any 
given one-minute period. These different schedules of reinforcement (100 per 
cent, ratio, interval) each yield different and characteristic patterns of be- 
havior. What human behavior depends on reinforcements of one kind or the 
other? Consider the victim of the partial reinforcement schedule doled out by 
a one-armed bandit at Las Vegas. Consider the workers who are paid a given 
amount of money for a given number of tons of coal dug or seams sewed. 


Effects of Partial Reinforcement 


In first training a subject 
reinforcement with every 
nder partial reinforcement, training is prolonged, but a response 
trained under partial reinforcement. will continue long after reinforcement 
stops. A response trained under 100 per cent reinforcement extinguishes 
quickly when reinforcement stops. The dr 
hibited by animals tr 


to give a response, it is most efficient to supply a 
response. U. 


Interval reinforcement 
POA 


foo Oar 
-i 


Figure 3-14. The ef- 
fects of 100 per cent re- 
inforcement and interval 
reinforcement on the 
number of trials to ex- 
tinction. (From W.O. 
Jenkins, H. McFann, and 
F.L. Clayton, J. comp. 
Physiol. Psychol., 1950, 
43, 155-167, p. 158.) 


Mean cumulative number of responses 


1.75 


Figure 3-15. The num- 1.65 


ber of unrewarded re- 
sponses is shown as a 
function of thc per- 


centage of reinforcement 
fi 


Mean log number of responses 


to extinction 


subjects received in 1.55 
training. (From DJ. 

Lewis and C.P. Duncan, Percentage of reinforcement in conditioning 
J. exp. Psychol., 1958, 


55, 121-128, p. 123.) 


33 67 


tinction occurs, the partially reinforced group is considerably more persistent 


than the other group. 

Quite similar results have been obtaine 
Donald J. Lewis and Carl P. Duncan rescued a condemned slot machine (one- 
armed bandit) from the axe of a crusading Cook County Sheriff and ingeni- 
ously adapted it to study the effects of partial reinforcement. The device was 
built to take quarters. As a consequence subjects were provided with a Hed 
supply of quarter-sized discs and told that they could play the slot mac ine 
as long as they pleased. The experimenters varied the percentage of rein- 
forcement during training between 33 and 100. Each disc the subjects won 
could later be cashed in for a nickel. After training, no further reinforcements 
Were given; the number of trials until the subject quit was then automatically 
recorded. Figure 3-15 shows the number of unrewarded responses subjects 
made as a function of the percentage of reinforcement they received in train- 
ing. Again we see the potent effects of partial reinforcement as compared with 
100 p inforcement. , 

hee penpan this finding? Whether a person ge a previously 
learned response depends on the similarity of the test sifuation to the training 
situation (recall the principles of stimulus generalization). Since in — 
the partial reinforcement group gives many responses that are not a 
by reinforcement, the extinction period is not a great change for them. But 
it is a dramatic change for the 100 per cent reinforcement group. Therefore, 
the partial reinforcement group continues to respond for a longer period of 
tim i ment is discontinued. 

ee dele clear implications for child training. When es P c 
to teach a child to perform an act we should reinforce him liberally. As the 


child gains skill in the act, reinforcement should taper off. By tapermg off we 
hen we are not nearby to apply frequent 


d in research with human beings. 


assure the response a long life even W 


reinforcements. 


47 


100 


Simple 


Learning 


Superstitious Behavior in Pigeons 
and the Shaping of Behavior 
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You can make pigeons 
chronically hungry by feeding them a reduced diet until they stay at 80 per 
cent of normal body weight. In this condition food as a reinforcement has a 
dramatic effect on whatever behavior it follows. In one of his experiments, 
Skinner placed hungry Pigeons, one at a time, in a Skinner Box and delivered 
reinforcements at random intervals. 

A pigeon tended to seize upon and repeat frequently whatever behavior 
it was engaged in just before the reinforcement. (Note the similarity of these 
pigeons to the behavior of the Olds and Milner “historic” rat that repeated 


behavior which had, by chance, been reinforced by the electrical brain stimula- 
tion.) As likely as not, then, this b 
of the next random delivery 
this behavior dominated th 


“beliefs” to superstitious notions that people lea 


i - hat approximate the desired 
response. For example, if an exper 
would make the animal hungry and th 
would reinforce any tendency in the appropriate direction _ 
nite responses in that direction, In this Way the animal ow 5 k n Ea 
the wall in a series of steps that gradually approached A lp og ce 
the first chapter, another example of res response. 
involving a mental patient. The principles Presented, one 
In almost all fields, such as academic te lentical. ; 
where the goal is to teach responses of one kind or ole ical counseling, 
shaping is used. Before a response may be shaped, wete, A 
must have an appropriate readiness for the task. Rendina, 
having available the responses required for a task. 


Ponse shaping was 
in both Cases are iq, 
aching or Psycholog 


the concept of 
child or patient 
is a matter of 
€adiness may be either 
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> Calcutta 
tR p v 


Figure 3-16. The pi- 
ano-playing duck turns 
es the lamp when given 
re signal, and then on a 
fed ratio schedule plays 
moe up and down 
E eyboard on the pi- 
; 0. (From Animal Be- 
havior Enterprises.) 


to be able to learn to read, a 
ditions of the task—that is, he must 


pable of discriminating among letters, and 
r gradually getting responses 


d with the appropriate level of reliability. 


physical or psychological. For example, in orde 


child must be physically ready for the con 
have eye coordination, be visually ca 
So on. Shaping then can provide a tec 
to occur in the desired situation an 


hnique fo 


An Example 


of Research in Operant Conditioning 


As we have seen, an 

organism trained to give a certain response to a stimulus will give this re- 
sponse to similar stimuli. This process of stimulus generalization has been 
explored primarily through classical conditioning procedures. Using operant 
conditioning techniques Norman Guttman and Harry Kalish studied it in 
Pigeons, One question they specifically investigated was this: If you condition 
a pigeon to respond to a light of a given color (pigeons have excellent color 
vision), how far will its generalization extend from that color? First, they 
trained a hungry pigeon to peck at 4 translucent light key (see Figure 3-17 


which presents a schematic diagram of the apparatus used in this experiment) , 
oing $0- Then by tilting the diffraction 


and reinforced the bird with food for d 
ected that pigeons would 


grating, they varied the color of the key. They exp 
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Diffraction 
grating 


Monochromator Light source 


Figure 3-17, Experimental apparatus used to test for generalization in the 
pigeon. The color of light seen by the pigeon on the translucent light key in 
front of its beak is changed by tilting the diffraction grating with respect to 
the beam of light. The shutter enables the experimenter to black out the light 
while changing colors. (From N. Guttman, and H.I. Kalish, Sci. Amer., 1958, 


198, 78-79. Reprinted with permission, Copyright © 1958 by Scientific Amer- 
ican, Inc, All rights reserved.) i 


Figure 3-18. Generalization gradie; 


ip ase nts obtained in pige ns for four difer- 
ently colored initial stimuli (shown b AETA for 


Y arrows). (From Guttman and Kalish.) 
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S 
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Percentage of total responses 


o 


Training stimuli tf fraser 

Spectr 
Berek RA eae 
Gin 


Yellow o 
a 7 range 
Color of light actually seen by pigeon 


enerali vithi Pe NE” 

= oe within the same band as the original training color; thus, a bird 
in z 

in ed to respond to a wavelength corresponding to a deep green would also 
5 z j f x 4 
pond to a wavelength corresponding to a lighter green. On this assumption 


th , ; A iii pr oe 
ey hypothesized that generalization would not “jump the color”; that is, if 


the itioni F ; . 
conditioning stimulus were green, the animal would not generalize to a 
particular bands of 


ae light. Notice that the names given to these 
gth originated with human beings. 
ee results did not support this particul 
egularity correlated with the names 0 
generalization in pigeons proceed quite regularly 
Wavelength. In Figure 3-18 we see four different gradients of generalization, 
ning at a specific wavelength. In all four cases 
d symmetrical around the original 
color boundaries (as human 
ttman and Kalish noted: 


ar hypothesis. Rather than sħow 
f the colors, the gradients of 
along with the dimension of 


each stemming from original trai 
the generalization gradients are regular an 
training light, Even when the gradient crosses 
beings perceive them) it remains smooth. As Gu 


iene curve of response was quite orderly: fast pecking at_wavelengths close to 
: training stimulus, diminishing rates of pecking at more distant wavelengths. It 
Was as if the pigeons were equipped with a frequency analyser. accurately identify- 
Ing cach wavelength. In other words they possess something like absolute pitch in 


the visual spectrum. 


nder two broad head- 


We have considered the simplest type of learning U 
g. Let us summarize 


ings: Classical Conditioning and Operant Conditionin 
what we have discussed so far. 
Classical Conditioning 


Salivation in dogs and the 
knee jerk in human beings ate resp 
training, if an adequate sitmulus is P 


onses that occur automatically, without 
resented. By pairing a neutral stimulus 
(CS) with the adequate stimulus (UCS), We can eventually make the re- 
sponse (CR) occur to the previously neutral stimulus alone. This process is 

ill also occur to a stimulus 


called classical conditioning. Further, the response W N 
similar to the CS; we call this stimulus generalization. We have shown how 


stimulus generalization may be useful in the explanation of more complex 
sent the CS without the benefit of the 


human behavior. If we continue to Pre f 
he CR. That is, it will no longer occur upon 
od, though, the CR will spontaneously 


e reported the following facts: 


UCS, however, we will extinguish t 
presentation of the CS. After a rest peri 


recover from the effects of extinction. W 
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1. Conditioning is fastest if the CS precedes the UCS by half a second. 
2. Though the process is difficult, it is Possible to use a CS as a UCS for a 
new neutral stimulus in order to produce higher-order conditioning. 


By making use of higher-order conditioning, it is possible to explain more 
complex learning (for example, learning of the emotional meanings of words) 
on the basis of simple conditioning principles. 


Operant Conditioning 


In operant conditioning a 
response typically occurs without any prompting by a specific stimulus im- 
posed by the experimenter. If it is followed by 
event, the strength and likelihood of this respons 
of responses conditioned by this procedure is 
sponses in human beings, bar- 
igeons, and so forth, 


in operant conditioning can be extinguished by lack of reinforcement. If 


in the original training, however, every response was not reinforced (called 
derably delayed. 


an appropriate reinforcing 
e will increase, The nature 
extremely broad: vocal re- 


forced by the UCS (salivation to the meat h i 
the electric shock); in operant conditioning the rasane skin A 
(pressing a bar, uttering a statement of Opinion). A related we ee in 
classical conditioning the UCS occurs without regard Sy a x ae 
behavior, whereas in operant conditioning the reward is : e subj ha 
occurrence of the response. Contingent on th 

There are other differences. It is not a difficult matter to condition re- 
sponses of the autonomic nervous system, such as the GSR or Blood as 
changes, by classical conditioning methods, Yet this is apparently ita 
nt a month of afternoons 
e he showed a spontaneous 
Some operant response such 


with operant conditioning techniques. I once spe 
dispensing nickels to an undergraduate every tim 
GSR. If the nickel reward had been contingent on 
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aS bar-pressing, the rate of bar-pressing would have shown a marked increase 
in this period of time. But no noticeable change in the rate of GSR’s occurred 
at the end of the month. Other researchers have also failed in attempting to 
condition a reaction of the autonomic nervous system by operant techniques. 
From such evidence some theorists have developed the idea that the central 
nervous system (more or less voluntary skeletal and muscular reactions) is 
controlled by operant conditioning, but that classical conditioning controls 
more or less emotional reactions). In apparent 


t! a 
he autonomic nervous system ( 
es in research reports of 


o iti : f 2 A 
s Pposition to this point of view are the many instanc 
individuals who have learned voluntary control over such autonomic reactions 
as constriction and dilation of the pupil and the GSR. Even in these cases, 


however, the process merely involved the classical conditioning of the au- 


tonomic reaction to a stimulus the individual could voluntarily provide for 


himself—such as a word. This means that although producing the word was 
Voluntary, the autonomic response to the word had been conditioned by 
Classical methods. Applying the distinction between autonomic nervous sys- 
tem and central nervous system to classical and operant conditioning has a 
good deal of merit. There may be exceptions to this distinction but it provides 
a correct definition of the central emphases of both kinds of conditioning. 
According to one line of theoretical thought, no reward is really necessary 
in classical conditioning. The UCS only functions to produce the CR in 
contiguity with the CS. All that is necessary is CS—CR contiguity. It has 
been maintained, however, that in operant conditioning the reward is 
essential for conditioning. Thus, classical conditioning is conditioning by the 
law of contiguity and operant conditioning is conditioning by the law of effect 
(reward). The argument with respect to classical conditioning is quite tenable. 
Yet, you will recall Brogden’s 1962 demonstration (described in Chapter 2) 
that merely by presenting a tone in contiguity with an operant response 
(cage turning), effective conditioning of his kittens resulted. This evidence 
Casts some doubt on the contiguity-reward distinction between the two types. 
In summary, we can point to many arities in operant and classical 


conditioning. In general terms the major 
conditioning relates to learning that requires V 
classical conditioning involves involuntary response 
sical conditioning seems more appropriate for learning that involves emotional 
conditioning such as fear or anxiety (in whic 
is involved) while operant conditioning is more applicable to responses of the 
rocesses (in W 
hould be understood as simply 


simil 
difference seems to be that operant 
oluntary responses, whereas 
s. More specifically, clas- 


h the autonomic nervous system 


skeletal musculature or higher mental p hich the central nervous 


system is involved). All these distinctions S$ 


representing relative emphases. It is not easy 
to design an operant conditioning study 


to separate the two forms of 


learning completely. For example, try 


that has no components of classical conditioning in it. 
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Complex Habits When an adult walks 


across a floor or reaches for an object, his behavior appears 
to proceed in a smooth uninterrupted stream. But slow 
motion movies of these behaviors would reveal that every 


act consists of many smaller ones. When you reach for 


something, for example, your arm is continually making 
slight adjustments to zero in on the desired object. This 
Suggests that many sequential, or continuous, acts are 
actually composed of a string of smaller learned habits. 


Some intuitively apparent examples are provided by a 


child spelling a word or a student going through a geo- 
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metic proof. In this chapter we shall examine some factors that control the 
chaining together of the relatively simple type of learning discussed in 
Chapter 3. 


Let us take a well-learned behavior sequence and analyze its characteristics. 


The recitation of the alphabet provides an example. First, note how rapidly 
and smoothly, and how free of halts or errors nearly everyone’s performance is. 
A fourth-grade child can often recite it as an indistinct blur of sound of three 
seconds’ duration. When serial behavior is accomplished in this manner, we 
say that skill has been acquired. Requiring the fourth-grader to recite the 
alphabet backward highlights the directional character of serial behavior. 
His time suddenly jumps to 45 seconds; and he must review parts of the 
alphabet in a forward direction to find his next response. A consideration of 
the alphabet also suggests that the later responses in a series are in large part 
determined by all the items that have come before. Benton J. Underwood 
and Rudolph W. Schulz have determined that if students are asked to give 
their first letter-association to the letter F, only 1.8 per cent answer G, but 
if asked to give their first letter-association to the combination E F, the 
Proportion responding with G jumps by a factor of 10 to 18 per cent. Give 
the class A B C D E F and G becomes the overwhelming choice for the next 
response. As the string of letters is increased the next item in the se- 
quence becomes more inevitably determined. That placing A B C D E before 
F increases the likelihood of G, suggests that G is partly determined by some 
small, remote S-R connections between each of these letters and G. Much the 
same sort of remote dependencies exist in other sequential, associative, and 
thought processes. A word in such a series can help determine a choice seven 
words ahead. (Interestingly enough, this is just about the average memory 
span; see Chapter 7.) Let us see what effect all these complex and remote 


connections have on serial learning. 


Serial Learning in Animals 


One night in 1934, at Yale 


University, after the students had deserted the psychology building, psy- 


chologists assembled in a long corridor to conduct an experiment with rats. 


They chose a long corridor because they had strung together seven straight 
long, and the total length of 42 feet ex- 


and narrow runways, each six feet 
al room. They worked at night since 


ceeded the size of their largest experiment 
they wished to keep the corridor empty while the rats were in the runways. 
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Figure 4-1. The goal 
gradient phenomenon in 
rats. This graph presents 
the amount of time im 
seconds it took a group 
of rats to cross each of 


e ; a 
Startoa) imee2 ans eM 7a e the eight sections of 
Gaul simple maze. (From C.L. 


Sections of the runway Hull, J. comp. Psychol., 
1934, 17, 393-422, Pp. 
404.) 


A small box was placed at each end of the 42-foot runway; one was the start- 
ing box and the other was the goal box. Hungry rats put in the starting box 
made their way down the runway to the goal box and food. 

The hypothesis was that the effect of the food reward would be greatest at 
the goal box and would decrease with distance from it. Consequently, a rat’s 
speed should increase as it moved down the runway. Each rat’s prowess across 
each section was timed and a curve (Figure 4-1) plotted of his speed. 

As Figure 4-1 shows, as a rat approached the goal box, his speed of running 
increased, reached a maximum just before the goal fae. aa at the very end 
slowed down a bit. The slowing down at the end was Seine by the small size 
of the goal box. The point is, if a rat rushed into the goal box at top speed, 
he would likely have crashed nose-first into the end wall. What i critical 
here is the demonstration of a general tendency i 
the vigor of their responses as they 1 
goal gradient, referring to the fact th 


for organisms to increase 
n * . 
ear a goal. This tendency is called a 


‘ at the effect of a reward diminishes with 
time and distance from the goal. Experiments on this tendency provided our 
y 1 


first hint that serial acts are not smooth, continuous sequences. The diminish- 
ing effectiveness of reward over time suggests that in tralai Ai ia 
small reward at the moment a praiseworthy act occurs will go a igh farther dit 
strengthening that act than a massive reward much later, i 

Investigators have also sought to chart errors as a func 
the act in which they occur. Results in the study of erro 
consistent in research with animals and men. In work with 


tion of the part of 
rs have been quite 
animals an appara- 
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tus similar to the one depicted in Figure 4-2 is common. This maze, used in an 
experiment by Clark Hull, had a series of four separate sections. The entrance 
to each section was divided into four doors. In order to complete the maze, a 
rat was required to go through a different door in each of the four sections. 
The rat received food only after completing the terminal section. The upper 
part of Figure 4-2 shows one possible pattern a rat had to learn in order to 
traverse the maze correctly. In this case, the rat had to go through door 1 
(counting from the animal’s left) in section 1, door 3 in section 2, door 2 in 
section 3, and door 4 in section 4. Did the 72 animals used in this study make 
a different number of errors at each of the four choice points? 


Choice points 


Start box 


sed to study serial learning in rats. Part A 
sible route through the maze; B presents a 
C shows the over-all nature of the maze. 
J. exp. Psychol.. 1947, 37, 118-135.) 


Figure 4-2. Straight maze u 
shows the floor plan of one pos: 
closeup of one set of doors; while 
(From C.L. Hull and AJ. Sprow, 


mber of errors differed at each of the 


Figure 4-3 clearly shows that the nu 
at points 2 and 3, the least at points 


choice points: Most errors were made 
1 and 4. Here then is more evidence 0 
various components of a serial task. Items at the b 


f differences in the ease of learning 
eginning and at the end 
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of a series are easier to learn than those in the middle positions. Similar re- 
sults have been obtained with human beings, the principal tool in this study 
being the rote learning of a series of words, 


Human Verbal Learning 


In 1885, Hermann Eb- 
binghaus published a remarkable book of experiments on memory. What 


makes this book remarkable is that Ebbinghaus was both the sole experi- 
menter and the sole subject in this entire series of experiments. For a period 
of about 20 years, Ebbinghaus learned, relearned, and memorized lists of 
nonsense syllables. These nonsense syllables, 
Chapter 1, were specifically invented for us 
retention. For his purposes, they had 
Because they were “meaningless,” 
Sponses were minimized. He constr 
each consonant-vowel-consonant co 
shuffle the slips and draw out betw 


which you encountered in 
e in studying verbal learning and 
to be simple to handle and construct. 
uncontrolled and previously learned re- 
ucted about 2,300 of them, writing out 


en 12 and 18 slips before each experiment. 
ular list of nonsense syllables, he put them 
j drew out another set. In each experiment, 


in the list at his own rate. Consequently h 


‘ y he spent more time on some syllables 
(the more difficult ones) than on others, 


Today, however, experimenters generally 
by means of a memory drum (see Figure 4-4 
one at a time, in the small opening. The am 
on each item is constant, generally about tw 
anticipate the next item on the list, If he ca 


Present such materials to subjects 
). With this device, items appear, 
Ount of time a subject can spend 
© seconds. The subject’s task is to 
nnot anticipate the next syllable or 


aE 

29 

5 Figure 4-3, Number 
mY of errors made at 4 
g diferent choice points 
2 7 m è a straight alley 
CA maze. (Adapted from 
2 Kimble, Hilgard 
Sis and Marquis’ condition- 
5 ing and learning. New 
5 6 (a eae York: Appleton-Century- 


i 2 3 4 Crofts, 1961.) 
Choice point 


Figure 4-4, A simple 
memory drum. (Cour- 
tesy Ralph Gerbrands 
Co.) 


makes an incorrect selection, the experimenter records the type of error. As we 
shall see later, the nature of these anticipatory errors tells us a great deal 


about the course of serial learning. 


We have mentioned a few 
phenomena that appear in serial learning by animals. In the Hull experiment, 


for instance, we found that the middle portion of a maze is most difficult to 
learn. This tendency also holds true for people learning serial lists of verbal 
materials. Probably one of the best demonstrations of this effect was presented 
by Carl I, Hovland. He had subjects learn a list which contained 12 nonsense 
syllables. He then counted the total number of errors each subject made at 
each of the 12 positions in the list. His results are shown in Figure 4-5, where 
you can see that the greatest number of errors occur with the syllable just 
past the middle of the series. This finding is called the serial position effect. 
If we compare this figure with Figure 4-1, which presents the results of a serial 
learning experiment done with rats, we see a similar serial position effect. In 
another experiment, using actual English sentences, the middle of the sentence 
proved to be the most difficult part for subjects to recall. It seems clear that 
the serial position effect shows up with a wide variety of both materials and 


subjects. 
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8 
#6 
2 
G 
54 
! m- 
T Figure 4-5. Mean gn 
3 ber of errors made 5 

i iti in 

3 g different positions 


i. les. 
list of nonsense syllab 
Be E d (From C.I. Hovland, J 
exp. Psychol., 1938, 23, 
172-190, p. 178.) 


Position of syllables in series 


Spelling a word provides an interesting instance of the serial position am 
Arthur R. Jensen compared the effect for errors in spelling seven-, nine-, oad 
eleven-letter words and the effect for errors in learning a series of nine colore 
geometric shapes. Figure 4-6 shows the serial position effect for both the mune 
letter words and the nine-item list. The curves are quite similar. Jensen dle 
carded the hypothesis that the spelling curve resulted from the ease of spelling 
prefixes and suffixes so that their location in a word might produce the effect 
artificially. He tested and found that these elements elicited about the same 
number of errors as the other parts of word: 


s. Further, only a small proportion 
of the words he used had prefixes or suffix 


es. 


Figure 4-6. Compar- 
ison of the serial posi- 
tion effect for spelling 
errors and for learning 4 
series of color forms. 
(From A.R. Jensen, J. 
educ. Psychol., 1962, 53, 
105-109, $. 107.) 


Mean percentage of errors 


0 


1 2 Ef) thee i af 8 #9 


Serial position 


10.42 


i 


10 
z 9.06 
9 8.86 
5 9 
RJ 
5 8 
Figure 4-7.. Mean num- E 7 EK 
ber of errors made to z 
each of the class labels. 3 
(From C.B. DeSoto and 2 0 — — —— 
Freshman Sophomore Juñior Senior 


JJ. Bosley, The cogni- 
tive structure of a social Class 
structure, J. abn. and 

soc. Psychol., 1962, 64, 

bp. 303-307.) 


So, although not all errors in spelling are a function of serial position, it is 
gest a practical 


certainly apparent that a large share are. It is difficult to sugg 
application of this finding, although one is very likely to result. For instance, 


to facilitate learning to spell, one might print the middle part of words in red 


so as to emphasize them. This suggestion corresponds to the von Restorff 
item in a series is set apart in a 


procedure in serial learning in which one 1 À 
Special manner. Sad to say, although the part set aside is learned more rapidly, 
what is gained here is lost through increased errors elsewhere. Performance on 

studies that have tried to re- 


the list as a whole remains the same. In fact, in 
duce errors in spelling by just such emphasis of difficult parts, the von Restorff 


effect holds: No improvement in spelling of whole words even though per- 
formance with the emphasized part of the word is improved. 

The von Restorff effect runs counter to the serial position effect. If the 
emphasized item is in the middle of a list it produces a pronounced drop in 
the very hump of the error curve. Clinton B. DeSoto and John J. Bosley 
suggest a persuasive interpretation of the serial position effect, one that also 
applies to the von Restorff effect. They had 28 college students, evenly di- 
vided according to class membership, learn to associate the labels “freshman,” 
“sophomore,” “junior,” or “senior” with each of 16 names printed on cards. A 
subject had three seconds to supply the label and could then check the back 
of the card to see whether he had been right or wrong. After each run-through 


of the deck of 16 cards, the experimenter shuffled the cards and allowed the 


subject to begin again. There was no serial order in any trial. Yet in the error 
curve for the four labels, presented in order in Figure 4-7, notice the resem- 
blance to the serial position curve. DeSoto and Bosley explain both their 


results and the serial position effect in terms of a subject’s search for refer- 
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Number of associations 


ence points around which he can build his learning. In a serial list of nonsense 
syllables the end positions serve as anchors; when there is no serial order a 
person will use the organization provided by the stimuli, such as class order. 
The von Restorff effect is another example of this search for a standard. 
Printing a nonsense syllable in a different color or a different size sets it up 


as the point of reference; consequently the learning of the rest of the list is 
built on the initial learning of this foundation. 


Associations in Serial Learning 


When we pointed out 
earlier that the probability of G as an association to F increased if F were 
preceded by A B C D E, we ascribed this increase to associations between 
each of these five letters and G. Such associations influence the errors made in 
the course of serial learning. 


Errors in list learning are typically of two major 
types: 


(1) Either a subject Says nothing when asked to anticipate the next 
word, or (2) he says a word out of sequence. Depending on the direction of 
the mistake, it is called an anticipatory error or a backward error. Antici- 
patory errors far exceed backward errors in number. Th 


e occurrence of both 
ty 


pes supports the notion that there are multiple associations among all words 
in a serial list. Thus, words appearing ear] 


y may serve as partial stimuli for 
words appearing later in the list. 


—— Forward 


——— Backward 


Figure 4-8. Number 
of forward and backward 
associations as a function 
of the remoteness be- 
tween two nonsense syl- 
lables in a serial list. 
(From JA. McGeoch, 
Amer. J. Psychol., 1936, 
48, 221-245.) 


Degree of remoteness 


of this sort gave an association at each position in the list. Note that asso- 
ciations are less numerous in the backward than in the forward direction; few 
associations are more remote than three steps away. 

To sum up: (1) Connections exist between all items in a series. (2) These 
connections are stronger in the forward than the backward direction. (3) 
These connections tend to affect serial learning by appearing as anticipatory 
and backward errors. In order to learn the total serial behavior these ten- 
dencies must be overcome. 

Rudolph W. Schulz has suggested that the more remote associations that 
Plague learners may be the result of generalizing context cues. One cue for 
a response in a serial list is the position of the item in the list. Subjects onen 
report that they remember that the second nonsense syllable is JIK. We 
know that generalization along positional dimensions is common. The context 
cue for position number 2 in a list is similar to that for position number 3. 
Because of the similarity of positions 2 and 3 the context cues for one might 
elicit the response for the other. Schulz has provided evidence supporting this 
interpretation. 


When a child first learns to say the word “doggie,” he usually applies it 
Bit by bit, after many corrections and reinforce- 


to horses, cows, and cats. 
age to dogs he regularly encounters. 


ments, he may begin to restrict his us 
Even though he may wonder about chihuahuas and wolves, he is learning a 
type of category-naming called concept formation. The child’s trouble with 
limits reflects the fact that the arbitrary categories we establish are matters 


of convenience, Nature is usually arranged in continua that spill over the end 


points of our concepts. 
What determines the ease of develop’ 


thesized that it depends on the kind of cı it 
represent concrete objects (trees, faces, hats) should be learned more easily 


than more abstract concepts (such as threeness or justice) that cannot have 
e referent. To test her idea, Heidbreder asked subjects to 


ing concepts? Edna Heidbreder hypo- 
oncept involved. Thus, concepts that 


a single objectiv ; 
learn the concept names of the pictures in Figure 4-9. She confirmed her 
hypothesis—subjects learned to assign a name to the different kinds of faces 
before they learned to respond with a name to the various pictures containing 


three objects. . E: i 
H.D. Baum, however challenged Heidbreder’s interpretation. In re- 
san , ; 


peating Heidbreder’s experiment he noted that subjects frequently experienced 
confusion between instances or examples belonging to different concepts. The 
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| STIMULUS OBJECTS Eo Figure 4-9. Types of 


stimuli used by Heid- 
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breder in her study of 
the development of con- 
cepts. Notice that al- 
though each of the stim- 


uli differs from the 
others, the four stimuli 
that carry a common 
name have a basis of 
similarity. (From E. 
Heidbreder, J. gener. 
Psychol., 1946, 24, 93- 
128. Adapted by D.D. 
Wickens and R. 
Meyer, Psychology, re: 
ed. New York: Holt, 
1961, p. 362.) 


most confusion occurred with instances that could elicit competing concept 
names. Thus, if twoness were represented by two faces, subjects often re- 


sponded with the name appropriate to “faceness.” Abstract concepts are almost 


always represented by instances that have many other competing concepts 


embedded in them. This is not so true of instances of concrete concepts like 
trees. These competing responses make concept learning a complex habit and 
are the chief reason that a child finds it more difficult to learn a Concent than 
a conditioned response. Consider the numb 
when a child is learning to acquire the res 
a skyscraper. 


er of potential competing responses 
ponse “building” to both a shack and 


Benton J. Underwood has Proposed a t 
relevant here. He suggests that learning 


n « or recognizi r 
one see relationships among stimuli gnizing concepts requires that 


He hypo ; 2 
such a relationship it is necessary that the — that in order to see 
SSOci 


each member of a group of stimuli, F ; 
and a blue square he must have the needled ore child sees a blue triangle 
he can see the relationship and form that concept “se to both stimuli before 
derstand that a group of animals are dogs he ae a F for a child to un- 
appropriately and the response “dog” must occur to sno earned to label them 
Underwood also requires that these associative tone gan of the sai 

ur in tempora! 


ative response occur tO 
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contiguity; the greater the temporal contiguity the less difficult the formation 
of the concept. 

In order to make it possible to conduct research along these lines, Benton 
J. Underwood and Jack Richardson prepared a set of verbal materials. They 
asked undergraduates to associate to each of a large group of words. The 
notion was that if they could get a number of words with a common associate 
(for instance, atom, crumb, flea and gnat all elicit the associate “small”), these 
could be used in the study of concept formation. They quickly discovered that 
free-association responses were too scattered and could not be usefully grouped. 
They then restricted their subjects to sense impression associates including 
such things as colors, shapes, sizes, textures, weights, smells, sounds and so 
forth, and in this way they found sufficient agreement for their research pur- 
poses. Thus, in the example given above, “small” was the sensory associate 
to gnat in 76% of the cases, to crumb in 79% of the cases, to flea in 86% of 
the cases, and to atom in 87% of the cases. To the word “eye,” 327% responded 
with “round,” 26% with blue, 10% with small, 8% with brown, and 6% 
with shiny. 

A good deal of research has been completed using these materials. As might 
be predicted it has been found that the greater the average probability of the 
stimulus-concept association in a group of stimuli, the faster the concept is 


attained. Take the four words 


Baseball Head 


What sensory-impression concept do the 
quickly came up with “round.” You might have also noticed “hard.” But 


you were most likely to come up with round first because as a sensory associate 
to these four words it has an average probability of 66.25%. Hard has an 


associative probability of only 8.25%. 
If we take another group of four words, 
ation. Take 
Knuckle Hailstone Skull 
What sensory-impression concept do these four suggest? In this case “hard” 
ge associative probability of 52.5%); 


is your most likely response (avera: : 
“round” is considerably less likely with an average associative probability of 


11.25%. 
Underwood and Richardson have shown that the probability of the concept- 


association is an extremely powerful variable determining ease of concept 
attainment. In these terms we can now look back at the Heidbreder instances 
in Figure 4-9 and understand better the relative difficulty in attaining the 
abstract concept. The association threeness is not a highly likely association 
to the picture of three mice; the association hat, though, is an extremely dom- 


inant one to a picture of a hat. 


Button Knob 
y represent? No doubt you very 


however, we can reverse the situ- 


Stone 
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A pianist playing a piano, a tennis player smashing an ace, an adult 
reading a book, and a telegrapher sending a coded message are all examples 
of highly skilled serial behavior. How can we characterize the learning of 
such skilled performance? First of all, we must realize that an adult, or child, 
generally comes to a skill-learning situation with a wide variety of habits al- 
ready available to him. These habits may be quite complex or relatively simple. 
For example, when learning to swim, a person knows how to kick, to move his 
arms around, to breathe in and out, before he actually goes into the water. 
These are all examples of relatively well-established serial behavior. They 
run off smoothly and without a hitch. Actual instruction begins when a teacher 
demonstrates the appropriate integration of these acts. For example, our 


neophyte swimmer knows how to move his head and how to breathe, but in 


order to use the breast stroke successfully, he must practice combining head 


movements and breathing, Combining these separate acts takes some time. But 
eventually the entire breathing and head-moving sequence runs off smoothly 
and becomes a single unit rather than a combination of separate units. Next, 
Kicking and arm strokes must also be integrated with the breathing sequence- 
When a person has become highly skilled in the breast stroke the total serial 


behavior runs off (1) without faltering and (2) without forced conscious 
awareness of the component units. 


and receive some words, he is also begi 
phrases. What seems to emerge from research in ski . 
skill 1 ing is this: is 
not so much that a person gets faster earning is this: a 
that he combines more and more of these small units into a si e units, = ic 

so that more is accomplished in “one stroke.” Single smooth u 
Typing provides another illustration of the combining of uni ` 
new typist the sequence of letters T, H, and E are just an e units, To s 
three letters. To the somewhat more experienced typist, T a a sequence a 
word THE, which she types at almost a single stroke he. >% on E are t : 
` er the sequenc 
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forms a more complex unitary response. Similarly, a highly skilled secretary 
probably considers the phrase: “In reply to your letter of the. . .” as a single 
complex response. She is able to type it without faltering. The way the various 
components combine in typing may be presented as follows: 


Early—Letter habit: I-n-r-e-p-l-y-t-0-y-0-U-r-l-e-t-t-e-r 
Middle—Word habit: In-reply-to-your-letter 
Final—Sequence habit: inreplytoyourletter 


There are many variables that will affect the speed of skill learning. One 
of the most effective of these is knowledge of results, especially when it is 
specific and immediate. The effect is reminiscent of rewards in operant condi- 
tioning. In World War II Fred S. Keller was charged with the responsibility 
of devising improved methods of radio operator training. By providing condi- 
tions for immediate reinforcement of correct responses, Keller dropped the 
failure rate in the school to a fifth and cut the hours of training to two-thirds 
the former level. One important feature of this training program that should 
be mentioned is that the trainees enjoyed it. Their enjoyment helped maintain 
their motivation at an appropriate level for the task. 

Do skills continually improve, OY do they reach a stable level? In everyday 
life it would seem that we do reach a stable upper limit, probably because we 
rarely have any clear indication of how well we are doing, and because we are 
satisfied with a relatively adequate performance. With championship athletes 
or artistic performers, however, the story is quite different. It is rare for peak 
Performance in either of these areas to be reached after just a few short years 
of intensive practice. When performance does level off it is probably due to 
aging. Instances of improvement in performance over a long period of time are 
hard to come by in laboratory situations, however. There is, though, some 


scattered data on the effects of continued practice in highly skilled perform- 


ance in industrial settings. In one analysis, an investigator examined the num- 
ber of cigars produced by a piece-work employee over the course of seven 
years, The results indicated that even after seven years’ practice, the cigar- 
maker still continued to improve his performance. Thus, in skill learning the 


uppermost limit of capacity is a rare exception rather than a general rule. 
e at the higher levels seem to depend a 


These increases in performanc 
The cigar-maker and the champion 


good deal on the interest of the performer. 
athlete increase their skill because they are interested in their performance 


whether for financial or personal reasons. Higher levels of skill are not 
reached by repetitious, half-hearted performance. Monotonous repetition, in 
fact, does not increase skill; it seems only to make lower-level performance 
more automatic. Here is another instance of how motivational factors shape 
the course of learning. Chapter 5 explores this influence in detail. 
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Motivation 


and Learning 


In Chapter 1 we intro- 


; Aca F b) as 
duced the notions of motivation a) as an energizer, b) 

, g wwe 
a stimulus, and c) as a need that can be satisfied. No 


i ivati in in 
shall discuss these three aspects of motivation agai 


greater detail. 


Primary Drive 


Within reasonable limits, 


increases in motivation lead to increases in activity A 


receptivity will run about nine miles a day in a squirrel cage; after being 
spayed, she will run less than a mile a day. You can intuitively understand 
the dramatic motivating effect of an electric shock, as described in the in- 
troductory chapter. These types of physiological motives (hunger, sex, and 
pain) are usually referred to as drives, specifically, primary drives because 
they seem to be built into the constitution of the organism, not learned as is 
a motive like the desire for sport cars. Like learning, such motivation is not 
directly observable. Here again, operational definitions help us in precise com- 
munication, since in any specific experiment we can define the level of a 
Primary drive such as hunger in terms of the number of hours of food dep- 
tivation, or the amount of effort an organism is willing to endure in order to 
gain satisfaction. As an example of the latter, a rat, deprived of food or sexual 
activity, may be required to cross an electrically charged grid to reach an 
appropriate goal object. The level of shock he is willing to endure gives us 
some measure of the strength of the drive. 

The strengths of drives have also been asses 
activity. In order to explore the effect of a prit 
W.T. Heron and B.F. Skinner starved some rats for many days, testing them 
daily during the course of the starvation. Before beginning the starvation pro- 
gram, they trained the rats to press a bar in a Skinner Box to obtain food pel- 
lets, and permitted the rats to eat their fill. Then, their daily diet was restricted 
to the food pellets they got as a result of four minutes of bar-pressing in the 
Skinner Box. This amount of food was too little to sustain life. Each day, 
following the four-minute period, the food delivery mechanism was shut off 
and the rats remained in the box for an additional hour. The increasing effect 
the daily changes in the number of responses made 
eached a peak on the fifth day and then de- 
ffer the physically debilitating effects 
t, responsiveness increases with 


sed by the resultant level of 
mary drive on activity level 


of hunger was assessed by 
during this hour. This measure T 
creased rapidly as the rats began to su 
of starvation. It seems clear that up to a poin 
increases in primary drive. 

Although at the present time we can only guess what this relationship would 
be if it were not contaminated by the effects of weakness, there is a simple 


experiment that might determine this relationship. It would be an adaptation 
of an old experiment by Tschukitschew, who found that when he transfused 
ell-fed dogs, the well-fed dogs began 


blood from very hungry dogs into very W 
to act hungry. So it might be possible to starv 
to test how many Skinner Box responses well-fed rats would give after receiv- 
ing transfusions from the differentially starved rats. Of course, the point would 
be that the transfused, well-fed rats would be “hungry” but their performance 


would not be affected by weakness. 


e rats to varying degrees and then 
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1500 


1000 
3 
<= 500 
: Figure 5-1. Change în 
: h 
the mean number of A 
: sponses per hour rao 
: 3 by 13 rats derinin sa 
o privation. 
0 l 2 3 4 5 6 days of food cap oe 
Bas (From W.T. Hero 


B.F. Skinner, Psychol. 
Rec., 1937, 1, 51-60.) 


structive experimental error ne; 
are very thirsty they don’t ea 
offered is dry purina. Therefor 


gated this support 
t very much 
e, the rats t 


; it seems that when rats 


vant drive in eo roduce 
some energizing effect.) People does p 
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Does Level of Drive Influence Learning? 


Does the level of drive 

have an effect on learning as on performance? To explore this question experi- 
mentally we must train subjects under different levels of drive (say, one 
hour and 22 hours of hunger) and then test to see whether learning differ- 
ences have resulted. One difficulty is that during testing the subject must 
be under some level of hunger. If he is fully fed before testing (zero hunger), 
then the ¢es¢ condition will be more like the one-hour than the 22-hour training 
condition. A decrement in response might result for the animals trained under 
22 hours of food deprivation simply because of the change in internal stimuli. 
Testing under 22 hours of food deprivation would be unfair to the one-hour 
group. 

A study by Donald J. Lewis and John W. Cotton made use of a special 
research design to overcome this problem. Two groups of rats were trained to 
run in a straight alley maze under one and 22 hours of drive respectively. The 
Next day, one-half of each group was tested after one hour of food deprivation 
and the other half after 22 hours. Testing consisted of seeing how many trials 
it took to extinguish the running response. Presumably if it took longer to 
extinguish, it must have been a more thoroughly learned habit. The results 
are presented in Table 5. The numbers in the table report the average number 


of trials it took to extinguish the running response. 


Number of 


Hours of Deprivation 


in Extinction Total 
1 22 
Hours of Deprivation 1 90 117 = 
in Acquisition 22 85 135 2 
Total 175 252 427 


Note in this table the totals of the rows (207 and 220), and the totals of 
ontributed to equally by 


the columns (175 and 252). Each column total is c 
groups trained under one and 22 hours of deprivation. Therefore, the effect 


of the training drive is equal for the two column totals. If the column totals are 
different they reflect performance differences brought about by the two drives 
during extinction. As we might expect, the higher drive (22 hours) during 
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extinction resulted in more responses before extinction was complete. Similarly, 
although the row totals are influenced by the drive during extinction, both row 
totals are equally influenced. Drive during extinction then could not produce 
a difference in the two row totals. The only antecedent condition that might 
produce such a difference is the drive during training. If drive during training 
did produce a difference in behavior during extinction, this would be the 
kind of relatively permanent change in behavior we ascribe to learning. In 
this experiment the row totals do differ. The higher drive for the 22-hour 
group during the learning period resulted in the formation of a maze-running 
habit whose extinction was prolonged. The effect is small but it is there. The 
same effect has been observed in other studies; even though it has not shown 
up in some studies, the sum total of evidence points toward the conclusion that 
learning under higher drive does lead to somewhat greater resistance to ex- 
tinction. 

But before we jump to the conclusion that we learn better under higher 


A 3 Boe 2 ; $ f 
drive, let us examine a persuasive interpretation of this result. The effect o 
higher drive has been observed onl 


observed that during learning, 
oriented to leaving the startin 
has begun, the high-drive grou 
while the low-drive group is a 
both groups may be learning 


When extinction testing comes, the quick exit from the starting box and the 
business-like traversing of the ma 


s 


y in maze learning. Experimenters e 
the high-drive group seems to be more strong y 
g box than the low-drive group. Once learning 


ments imposed by the experim 


enter, These considerations suggest that differ- 
ences in drive are more likel 


y to produce qualitative 
than quantative changes in learning. Th 


responses, rather than different degrees 
also teach us that when we restrict ourse 
so rigid a yard-stick as number of trials 
important insights into the processes w 


changes in learning 
at is, animals learn slightly different 
of the same response. These proposals 
lves to evaluating performance against 
to extinction, we run the risk of losing 
€ are studying, 


Interaction of Drive and Learning 


In Chapter 1 we saw what 
happened when a rat, well educated ina T-maze, had eaten his fill—he slept- 
As we pointed out, this shows that berformance depends on both motivation 
and learning. Clark Hull has proposed that their interaction must be multi- 
plicative, not merely additive. That is, to determine what behavior will 
result in any given situation, we must multiply the drive level of the organism 
by the level of learning that he has achieved. 


(This can be achieved by con- 
Motivation 
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verting both into arbitrary units.) If either is at the zero level we will get no 
responses. This hypothesis is quite useful in predicting behavior under dif- 
ferent levels of drive. It has recently gained in importance since anxiety has 
been viewed as an energizing drive. Thus, we may use this hypothesis to predict 
the relative performance of persons with high and low anxiety on simple and 
complex tasks, But before we consider this proposal further, let us first see why 
anxiety may be considered a drive. 


A Learned Drive: Fear 


Criteria for the Existence of a Drive State. We have shown how rats learn to 
fear a buzzer and how Albert learned to fear a rat. About the most reliable 
demonstration experiment in psychology consists of the conditioning of fear. If 
We use a distinctive CS and a strong electric shock, we can almost always ob- 
three trials. Fear is generally 


tain conditioning of a fear response in two or 
e criteria for drives. What are 


classed as an emotion. In addition, it meets th 
they? 


1. Drives increase the activity of the organism. Recall the Heron and 
Skinner starvation study and the sexually aroused female rats in the squirrel 
cage, i 
ew learning. A hungry rat will learn to traverse a 


2. Drives can motivate n 
When he is not hungry 


rather complex maze to get to a food-laden goal box. 
he may fall asleep in the starting box. 


eries of studies, Neal Miller demonstrated that 


anxiety could be considered a drive in terms of these two criteria. (The words 


anxiety and fear will be used interchangeably.) He placed rats in a box with 
h a grid floor, and. the other black. The rats 


Their indifference was modified by 


In a carefully planned s 


two compartments, one white wit 


were at first indifferent to this treatment. 
shocking them ten times in the white compartment. Each time they were 


allowed to escape into the black compartment. Later, when placed in the 
white compartment without shock they ran quickly into the black one, thus 
demonstrating that their activity was increased by their fear response to the 
cues of the white compartment. Fear, then, satisfies the first criterion of a drive 


state. But the second criterion, new lea 
learned running response could have been 


rning, is not proved, since mere in- 


creased activity or a previously 


operative. 
In order to demonstrate that the acquired anxiety could motivate new 


learning, Miller altered the box by closing the door between the white com- 
partment and the black compartment. Now the rats could only escape from 
the white compartment by turning a drum that opened the door. When 
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Figure 5-2. Apparatus 
used to train fear. Com- 
partment A is painted 
white, compartment B, 
black. Electric shocks 
may be given in compart- 
ment A. Under different 
conditions the door 
(painted with black and 
white stripes) may be 
removed, and a low hur- 
dle put in its place. 
(Adapted from N.E. 
Miller, “Learnable drives 
and rewards,” in SS. 
Stevens (ed.), Handbook 
of experimental psychol- 
ogy. New York: Wiley, 
1951.) 


placed back i i 

extreme re ai baap irin the rats manifested the usual signs of 

about and accidentally t me eatoni crouching. Eventually, they moved 

run into the black edi ni orun when the door opened they could 

and running into the te Sie Tuet sperd in manipulating the drum 

trials, thus indicating that ieee rapidly with further such 
Next, Miller more clearly established ee heel ene as a 

‘J J a 


se devel 
y Teaia, te te occurred without any additional 
i woe at 0 ‘the cies i 3 
motivated activity (just as hunger midit es in t 
g 


into the black compartment was a rew: 
as food might have been if the rat ha 
terms of our criteria learned anxiety 


he white compartment 
$ motivate activity) and the escape 
ar 

to the newly learned response (just 
d been hungry), 


: It seems clear that in 
Is a drive, 


Fear-avoidant " 

beds oo Their Extinction, As a drive, f ee 

a shode When arat Enea cA fear, ran to the black lina es ateccal 

reduced, and this reduction reese: of the black compartment it: ‘a was 

nae Use cas reinforced the shock-avoid its fear 
sponses and successful fear-avoida ant response. Such 

resistant to extinction, as the followin nce responses are extremely 


; ý & example shows. Ri 
has trained dogs to avoid a severe electric shock bike Richard L. Solomon 
Y Jumping a shoulder-high 


hurdle separating two compartments. Ten seconds aft 
er the dog la i 
g lands in the 
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“safe” compartment he must jump back into the first compartment to avoid 
another shock. The same thing recurs in the first compartment, so the dog soon 
learns to spend all his time leaping back and forth between compartments. 
Figure 5-3 shows some interesting features of the dog’s behavior in learning 
to avoid shock. 

The important thing to keep in mind in studying this figure is that if the 
animal takes longer than ten seconds to respond it will get a shock. In this case 
the dog received only seven electric shocks, avoiding further jolts by jumping. 
By the twentieth trial the experimenter had turned off the electricity com- 
pletely. Nevertheless the response continued to occur. Some dogs that have 
just been left to jump have continued to leap hundreds of times. Virtually the 
only way to extinguish the response is to prevent it by putting a ceiling on 
the box, After a desperate period of extreme fear the dog eventually calms 
down and does not jump even when the cı 
shock, though, will set him off again. 


eiling is removed. Any hint of 


100 


50 


Figure 5-3. The per- 
formance record of one 
dog learning to avoid 
shock, The dog was 
Shocked if he took longer 
than ten seconds to re- 20 
spond. The 10-second 

point is indicated by the 

horizontal line, All re- 10 
Sponses above this line 

(trials 1-7) were shocked. 

All responses below the | 
line (trial 8 on) enabled 5 
the animal to escape the 
Shock. The arrow indi- 3 
cates the point at which i 
shock was permanently 
turned off. (From R.L. 
Solomon and L£. 
Wynne, Psychol. Mon- 
ogr., 1953, Vol. 67, No. 
354, p. 6.) 


Latency in seconds 


Go aa o 30 407 Eo 


Transfer 


of Training 


Why is this response so resistant to extinction? If we stop reinforcing 
salivation to a CS it will soon stop; if the food is not in the goal box at the 
end of the maze the rat soon stops running. The crucial difference may be that 
in this instance of avoidance conditioning some reinforcement continues even 
after the experimenter has stopped administering electric shocks. As the end 
of the ten-second period draws near the dog begins to experience fear; when 
he leaps into the other compartment his fear is reduced, thus providing a 
reinforcement. Each time the avoidance response occurs, then, there is some 
reinforcement. One argument against this interpretation, however, is that 
after a dog has been in the apparatus for some time he usually performs 
his jumps every 1.5 seconds, vet the measurable latency of most fear re- 
sponses (measured by indices such as GSR, heart rate change, blood pres- 
sure change) is greater than 1.5 seconds. So if the fear response has not yet 
occurred, how can the jumping response reduce it? The answer might be that 
there are components of fear that precede the measurable components. Per- 
haps these early components are the ones that are reduced. 

Many theorists have explained neurotic symptoms as responses that fend 
off anxiety, Such symptoms keep a person from thinking anxiety-producing 
thoughts or serve to postpone or avoid anxiety-producing stimulation. For 
example, in obsessional neuroses individuals complain about persistent ideas 
that run through their minds and dominate their thinking. These thoughts 
may successfully insulate the individual from other, more distressing ideas- 
Relevant to this, it is difficult to treat some neurotic symptoms, about as 
difficult, perhaps, as extinguishing some anxiety-avoidant habits. 


Anxiety in Human Beings. The most common way of defining human anx!- 


ety is in terms of scores on personality questionnaires, the best-known and 
most heavily used of which is Janet A. Taylor’s M 
test, a subject is asked to Say ‘ 


than other people” and “I blush easily.’ 


anxiety, which in turn indicates high drive, 
of the multiplicative interaction of learning and drive in determining per- 
formance, Taylor predicted that highly anxi 
susceptible to conditioning because of the 


effect of the higher drive. (Notice 
that in this case anxiety is an irrelevant 


drive.) A considerable amount of 
research has indicated that high scorers on the Manifest Anxiety Scale do 


indeed show more effective conditioning. As you can see in Figure 5-4 highly 
anxious individuals begin exhibiting more vigorous eyelid conditioning early 
in the conditioning session and widen the difference by the end of dhe period. 
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d, or in some 


y one response is measure! 
o more con- 


ergizes that one response, S 
to more complex learning, the 


In classical conditioning, often onl 


cases permitted. If drive increases, it en 


When we move 
ore complex. A learning situation is com- 


responses other than a correct one are 
tter of learning, the correct response 


dii 
itioned responses result. 
Picture becomes correspondingly m 
plex, when, for one thing, many 


Possible. In addition, since it is a ma 
would not be the most likely one. If it were, there would be little to learn. 


Anxiety as a drive energizes all the habits that are evoked in the situation, 


incorrect as well as correct. Consequently, in a complex situation in which 
ust compete with stronger tendencies 


y multiplying the strength of both 
fference between them to the 


a weak tendency to respond correctly m 
high anxiety, b 


ase the absolute di 
arbitrary example, if at one drive 


as two units of strength and the incorrect re- 
psolute difference would be three units 
double the drive level, the response 


to respond incorrectly, 
tendencies, should incre 
detriment of the correct response. For an 
level the correct response h 
sponse has five units of strength, the ak 


in favor of the incorrect response. If we 
strengths also double, becoming four and ten. The absolute difference in 


favor of the incorrect response is NOW six units. The deduction following 
from this relationship is that highly anxious persons would perform worse than 
less anxious ones in complex learning situations. Research has provided fairly 


consistent support for this deduction. 
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There is one difficulty here, however. When the experimental procedures 
do not threaten the subjects no difference has been found between individ- 
uals with different degrees of anxiety. The greatest differences have been found 
where some threat has existed in the situation. This suggests that a high 
score on the Anxiety Scale indicates a readiness to experience anxiety in 
appropriate circumstances rather than a chronic condition. The anxious person 
does not appear to “carry his anxiety around with him.” 


Learned Hunger Drive? 


Although learned fear is 
easily demonstrated, there has been great difficulty in providing unequivocal 
evidence that positive drives such as hunger which motivate approach 
responses can be learned. The difficulty may lie in the exclusive use of ani- 
mals. We know for sure that human beings have many learned positive drives- 


They will work hard and learn many new responses to acquire prestige and 


wealth, neither of which directly Satisfy primary drives. But about animals 
we are not certain. 


problems. 


In an experiment paralleling Miller’s r 


ie : esearch on learned fear, an attempt 
was made to train “hunger. Essentially, Miller had provoked fear in his 


8roups were then fed in the striped 
cod. Apparently, they had learned 
have a good idea that learned fear 
ted with arousal of the autonomic 


box, the experimental group ate more fi 
to respond to stripes with hunger. We 
involves physiological activities associa 
nervous system. What physiological concomitants are there for learned 
BURGE? Perhaps, it would baye been isein ty have measured stomach con- 
tractions in this experiment. (While it has been difficult to replicate this 
finding, it has been described for its heuristic value.) p 
It is clearly more difficult to arrange conditions 


to teach hunger than it is 
to teach fear. Miller has suggested that the sudden onset of fear ok it easy 


to associate with a specific external stimulus. Hunger takes a while to develop; 
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you cannot turn it on suddenly. Consequently, it is difficult to pair in a neat 
fashion with an external stimulus. 


As we have just demonstrated, drives have energizing properties. Further, 
as we pointed out in Chapter 1, associated with these drives are charac- 
teristic stimulus patterns. Operationally, it is difficult to distinguish between 
the conditions necessary to produce the energizing properties and the stimulus 
Properties of drive. In the case of hunger, food deprivation does both. Then 
why make the distinction? For one thing, by using an independent measure 
of response such as activity in a squirrel cage, or rate of bar pressing as a 
Standard, we can “equate” two drives, Say hunger and thirst, for their ener- 
gizing properties. We know, however, that the stimuli growing from stomach 
Contractions and dryness in the throat would be different. If these are dis- 
tinctive stimuli in the usual sense, it should be possible to train different re- 
sponses to each. Clark Hull and Robert Leeper conducted early experiments 
demonstrating this possibility. They deprived rats of food on some days and 


Water on other days. On foodless days the rats had to turn right in the maze 


to get food; on waterless days, they had to turn left to reach water. The 
ermining which direction to turn were their 


only means they had of det : à j 
internal drive stimuli. It turned out that rats were quite successful in learning 


to respond correctly to their internal states. 
Afterwards, though, it was argued that a discrimination between drive 
, 


stimuli had not necessarily been established, for on thirst days the rats were 
given as much food as they would eat just before the test trials. Could it 
have been that the rats only learned to respond to an empty versus a full 
Stomach? Subsequent research, however, studying only the drive stimuli of 
hunger, showed that rats could learn to turn left or right depending on 
whether they were experiencing drive stimuli resulting from 11.5 hours or 
47.5 hours of deprivation. In both of these groups the rais PETE VRAE EN: 
completely empty stomachs but they were able to respond in accordance with 
their drive state. It seems clear that drives have distinctive stimuli associated 


with them and that responses may be learned to these stimuli. 


In Chapter 2 we introduced contiguity theory through the work of W.J. 


Brogden. This theory maintains that only one condition is necessary for 
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learning—the co-occurrence of a stimulus and a response. The law of effect, 
or reinforcement theory, Tecognizes the necessity of contiguity but insists 
that it is insufficient—reinforcement is also necessary. Reinforcements can 
take an alarming variety of forms. Olds and Milner reinforced by electrical 
brain stimulation; Salzinger and Pisoni reinforced by social approval. What 
is the nature of a process that can apply to both of these disparate phenomena? 


The Nature of Reinforcement 


Clark Hull saw motivation 
and reinforcement as being related to the Darwinian theory of natural selec- 
tion. As he portrayed these phenomena, they have survival value for an 
organism. Thus, it is useful for an animal to become active after missing @ 
meal since this will increase his likelihood of discovering one. If his partaking 
of this meal (reinforcement) increases the likelihood of the acts that made it 
possible, then the probability of the continued existence of the animal and, 
consequently, the species is enhanced. In this system, motivation functions 
to increase the tension level of the organism; reinforcement leaves its mark 
by reducing this tension level. Food reduces the tension related to hunger; 
water does the same for thirst: copulation reduces sexual tension; pain 1s 
reduced by its termination or lessening; learned fear is reduced by removal of 
the appropriate stimuli. One problem in this explanation is that the reinforce- 
ment acts backward in time, affecting the probability of a response that pre- 
ceded it. This is illogical: an effect cannot precede a cause. Hull recognized this 
difficulty and suggested that a response is followed by a neurophysiological 
Process called a trace, which “represents” the response in the nervous SyS- 
tem. It is this trace that is reinforced. But how is tension-reduction involved 
in the stimulation of the brain? Perhaps what Olds and Milner discovered 
is the center in the brain where tension-reduction is registered, Direct internal 


stopped. Despite this and other faults, howe 
one explanation of reinforcement that acco 
servations. It seems likely that the next d 
from the laboratories of those psychologist 
learning. 


ver, tension-reduction remains the 
unts for most of the data and ob- 
evelopment in this area will come 
S studying the neurophysiology of 


In summary, tension-reduction is currently the ex 


é Planation of the nature 
of reinforcement that explains most of the data. As 


is 8enerally true of the 
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dev i iw i 
a of science it will not be discarded because of some contrary 
at zi ii 
Pa ence. It will be replaced when a better explanation is available, most 
ikely a neurophysiological one. 
So much for the nature of the reinforcement effect. What is the status 


of rei : 5 à 
einforcement in current psychological theory? Demonstrations that 


learning can occur without reinforcement, such as that of Brogden’s, are not 
ae in the literature. Such evidence eventually caused Hull to place 
ditt ae 4 asis on the role of reward in motivating behavior. Hull was the 
shift nt nent of the law of effect in the second quarter of this century. His 

emphasis in his theoretical orientation reflects that of most learning 
Tesearchers, who now generally view reinforcement as being 
Portant in performance, but as exercising little direct effec 
Through its role in determining performance, however, reinforcement retains 


a crucial role in learning. 


extremely im- 
t on learning. 


ives that are satisfied by the organism’s 


To this point we have discussed mot 
f motives that can best be satisfied 


i iaa 5k ; 
ee its activity. There is also a class 0 
y a cessation or change of activity. 


The Need for Stimulus Change 


At McGill University 22 
ri college students were given $2 
ying in a soundproof room on a foam 


0 for every 24 hours they would spend 
rubber bed, wearing translucent goggles, 


gloves, cardboard cuffs around their arms, and a U-shaped foam rubber pillow 
for their heads (see Figure 5-5)- Nothing was required of them; in five days, 
though, they could earn $100. Yet, few of them were able to stand the job 
more than two or three days. The students found it exceptionally difficult to 
sleep or think; they had hallucinations and became panicky; and they dealt 
Poorly with intelligence tests introduced during their stay in the room. When 
they emerged from the experiment they were often disoriented, confused, 
nauseous, and fatigued for periods up to 24 hours. While some of this effect 
is due to the suggestibility of the subjects, the root of this disorder of behavior 
is lack of satisfaction of a need for stimu 

Perhaps the capacity to be bored is one of man’s important qualities, though 
we share this capacity with lower animals. Rats and monkeys, at least, have 
shown a need for changing stimulation which can motivate new learning. 


In one experiment Robert A. Butler and Harry F. Harlow showed that non- 
tiate between panels of different 


Jus change. 


hungry monkeys would learn to differen 


8r 
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colors with no other reward than 

an the opportunity to look out a 

window into a different room. 

When a monkey pushed a panel 

door of one color the panel opened 

and he was permitted to look 

through into another area for 30 

seconds. When he pushed the 

per other-colored panel it did not open. 

: ‘ Monkeys learn to discriminate be- 

tween colors on the basis of this 
type of reward alone. 

In another experiment rats were 


i x% 


; z : i istinguish between the 
Figure 5-5. Typical experi- trained to distinguis oe 
mental arrangement used in white and black arms of a T-m 
sensory deprivation studies. The only reward for a correct 
(From Gateways to the Mind . ity to ex- 
“Sei, P rtunity to 
Bell System Science Series choice was the oppo es y for 
film.) plore a more interesting maze 


one minute. The mean number of 
correct choices in the T-maze 


ber of trials increased, Rats chose 
us change, 


showed a significant increase as the num 
the site that provided the greater stimul 

The results of all these experiments indicate that both men and animals 
respond favorably to changes in stimulus. Indeed, this desire for a change in 
stimulus conditions is strong enough to induce the learning of new responses 
that will bring changes about. If “boringness” of a stimulus condition leads to 
a tendency to get away from that condition, then the effectiveness of novelty 
in evoking new behavior should diminish as an animal becomes more familiar 
with a new situation. In support of this Supposition, a number of studies have 


objects. Due to stimulus gen- 
familiar ones will also be ignored. 
e others we have mentioned and 
r a change” applies equally well to 


eralization, other objects similar to the now- 
This result is perfectly congruent with th 
would suggest that the slogan “It’s time fo 
stimulus conditions and to politicians, 


The Need for Cessation or Change of Activity 


Animals seek stimulus 
change; research on response boredom tends to emphasize fatigue or the 


need for rest as the critical factor. From some rather ingenious demonstrations 


by Kurt Lewin and his coworkers, however, we know that fatigue as an 
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explanation may not always be completely accurate. In one study, for 
example, a subject was instructed to copy a given figure repeatedly. After a 
short time he complained that he was tired and could no longer continue 
drawing. Thereupon, the experimenter asked him to write out a description 
of what he felt and thought about the task. Without hesitation the subject 
picked up the pencil, wrote out his description and even included a drawing of 
the figure he had just said he could no longer reproduce because he was so 
tired. Clearly, there is more to response boredom than simple fatigue. But this 
does not deny that boredom develops; its importance to learning cannot be 
overestimated. We are all sorry witnesses to the necessity of repetition in 
learning material of any degree of complexity. Learning would be greatly 
facilitated if the effects of response boredom could be reduced. Let us now 
turn to an examination of the various ways repetition or practice may be 
arranged in order to facilitate the learning of new materials. 

Following the notion that fatigue is instrumental in response boredom, 
investigators have arranged the learning of materials so as to test the effects 
of rest, during which fatigue could dissipate. Carl Hovland interpolated rests 
between items in a list of 12 nonsense syllables and also interpolated rests 
between trials on the total list—either two seconds or four seconds between 
items, and either six seconds or 126 seconds between lists. There were four 


different groups. 


Group 1 had two seconds between nonsense syllables and six seconds 


between lists. 
Group 2 had two seconds between nonsense syllables and two minutes and 
six seconds between lists. 
Group 3 had four second 
tween lists. 
Group 4 had four seconds between nons' 


six seconds between lists. 


s between nonsense syllables and six seconds be- 


ense syllables and two minutes and 


are shown in Figure 5-6. The two top curves 
d 2 (item interval of two seconds) ; the bot- 
for groups 3 and 4 (item interval of four 
at greater spacing, both between items and 
between separate repetitions, produce fewer errors and better learning. The 
effect of spacing is greater, however, between items than between trials. That is, 
a very small amount of rest between individual items in a series more than 


compensates for a relatively 


the whole series. Interitem ri 
e. Distributed or spaced practice produces better learning of serial lists 


d practice. This is true for both spacing between items and 


The results of this study 
show the results for groups 1 an 
tom two curves present the data 
seconds). The results indicate th 


large amount of rest between complete trials of 
est probably allows for dissipation of response 


fatigu 
than does masse 


83 


Motivation 
and Learning 


2-second rate between syllables 


e— 6 seconds between lists 


@-=~ 2 minutes, 6 seconds 
between lists 


g4 = 
£ Se 
— ~ - 
5 = =. 
3 2 5 a 4-second rate between syllables EA 
’ z 

2 a e—-—e 6seconds between lists 

A Ay °——* 2 minutes, 6 seconds between lists 

= 


SS ES SSE SER 
2 3 4 5 6 7 8 9 im a B 
Position of nonsense syllable in series 


Figure 5-6. Effects of interitem and interlist rest periods on the serial 


position effect. Note: In this figure the ordinate of the graph counts the 
number of errors, so that a high score indicates a poorer performance than a 
low score. (From C.I. Hovland, J. exp. Psychol 1938, 23, p. 178.) 

+ 1938, 23, p. k 


spacing between lists. (Similar findings have also been reported for rats learn- 
ing serial mazes.) 
Does the efficacy of spaced practice apply to all ty 


i a? 
pes of learning tasks? 
The answer is, mainly, yes. 


Not only does distributed practice help in the 
ense syllables, but it also facilitates the learning 
of motor tasks such as sawing wood, driving a car, knitting, and bicycle riding. 
In fact, this effect is greater for motor tasks than for serial y 
Psychologists have studied motor learning with an a 
pursuit rotor. Figure 5-7 shows a simple example of this t 
Here a subject’s task is to keep the stylus (A) 
target (B), which is set near the edge of the rey 
pletes a circuit that runs an electric clock, The s 
target. In one experiment by Gregory A. Kim 
groups of college students w 


learning of serial lists of nonsi 


lists. 

pparatus called a 
ype of equipment. 
in contact with the circular 
olving table, Doing so com- 
ubject’s score is his time on 
ble and Robert Shatel, two 
ere each tested for ten Consecutive days, Each 
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Figure 5-7. Rotary 
pursuit apparatus. The 
subject’s task is to keep 
the stylus in contact with 
the circular metal tar- 
get while the platform 
revolves continuously. 
(Photo courtesy Lafay- 
ette Inst. Co., Lafayette, 
Ind.) 


day they had fifteen 50-second trials. In the massed practice condition there 
was a five to ten second rest between each trial; the spaced group had 65 to 70 
seconds between trials. The results of this experiment are presented in Figure 
5-8. For each of the ten days on the graph, the first, second, and last points 
present the actual figures for trials 1, 2, and 15. The third point represents 
the average value of trials 3 to 8: the fourth point represents trials 9 to 14. 
The percentage of time subjects were on the moving target in each 50-second 


Figure 5-8. Effects of massed and distributed practice on motor learning. 
For explanation of the graph see text. (From G.A. Kimble and R.B. Shatel, 


J. exp. Psychol., 1952, 44, 355-359, P. 356.) 
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period is plotted on the ordinate of this graph. The figure reveals a number 
of results. 


1. Clearly, spaced practice aided performance on the task; learning under 
spaced practice increased more quickly and reached a higher level at the 
end of ten days than learning under massed practice. 

2. Note that both groups show a marked increase from trial 1 to trial 2 
every day. This is known as the warm-up effect. This reflects the need, on 
beginning a task after a long rest, for some practice to get back in the groove. 

3. After this initial spurt, continued practice in the massed practice group 
often results in a decline in performance. This decline is called the war 
decrement, or reactive inhibition, and is commonly associated with learning 
through massed practice of the same response. 

4. Compare the second trial on days 2, 3, 4, and 5 with the last trial of the 
preceding day (we use the second trial and disregard the warm-up effect). 
Notice the marked improvement in performance that resulted from the rest, 
and without practice. This improvement, called reminiscence, represents 
recovery from the work decrement and also suggests the magnitude of the 
decrement. The lesser improvement in the spaced group corresponds with our 
expectation that they would suffer less build-up of work decrement. 

5. Here again we see an instance of the need for the distinction between 
learning and performance. The declining performance after the warm-up 


effect for days 2, 3, 4, and 5, is actually a period of increasing learning. After 
the dissipation of the work decrement the 


6. There is, over and above the war 
place overnight. The longer the interval 


the forgetting. The curves for days 2, 3, 4, and 5 for the massed group seem 


to show no forgetting (again discounting warm-up). This is because their per- 
formance is so badly retarded by the work decrement, 


effect of this learning shows itself. 
m-up effect, forgetting, which takes 
between practice sessions the greater 


The advantages of spaced 
Still, when the material to b 
difficult, massed pr 


outweigh its disadvantages- 
brief, and not inordinately 
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What can we conclude? In learning most tasks, it helps to insert regular 
rest intervals into practice as often as is practical. Such spacing is most 
beneficial with motor tasks. In fact in learning motor tasks, we can often gain 
more from a period of rest than from continued practice. When learning verbal 
material by rote, such as poetry or a speech or historical facts, frequent rest 
between items also increases efficiency. When we come to learning more 
complex tasks, spacing can still help us where the materials are unfamiliar. 
Thus, in learning vocabulary in a new language, or mastering a mathematical 
proof involving unfamiliar concepts and symbols, spacing of learning is useful. 
On the other hand, spacing of practice only wastes time where the responses to 
ar but have to be given a new meaning or connected to 
learning a variant of techniques using 
mastering a list 


be learned are famili 
a different stimulus. In mathematics, 
familiar operations and symbols, or in language learning, 
of cognates, the tasks proceed as well with or without rest intervals. 

In this section, we have brought together, sensory deprivation, and work 
decrement, both of which are variables that result from the monotonous repe- 
tition of stimulus or response conditions. We described the way each can 
influence learning and retention. Sensory deprivation seems to result in major 
disruptions in behavior and in a strong need for stimulus change. If stimulus 
change is given it provides a reinforcement that increases the probability of 
the preceding response. Work decrement (also called reactive inhibition) 
is a form of accumulated response fatigue that results from the repetition 
of responses during learning. Spaced practice, or the allowance of frequent 
rests, causes less work decrement than massed practice since it permits 
accumulated response fatigue to dissipate. Consequently, the learning of verbal 


and motor tasks is usually aided by spaced practice. Motor tasks benefit more, 
result in greater accumulation of response fatigue. 


perhaps because they 
t in short learning tasks and in cases of learning 


Massed practice is more efficien 


a new organization of very familiar material. 
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Motivation 
and Learning 


Transfer of Training New York City is dotted 
with playgrounds that provide outdoor handball courts- 
As in tennis, boundary lines mark the playing area in these 
courts; the focus of a court is a front wall against which 
players propel a ball, using a motion best described as a 
slap. The players are free to step anywhere, but the ball 
must only touch down within the confines of the boundary 
lines. As I learned the game in daily play, it was a free and 
open sport requiring vigorous running. The reason that 


this blatant nostalgia is relevant to a discussion of transfer 


of training lies in what happened when I recently accepted 
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a handball challenge from a graduate student. Because of my earlier extensive 
practice in outdoor handball I was sure that I would more than hold my 
own, even though we would be playing indoor, or four-wall, handball. Now, 
four-wall handball is played in a windowless room and the focus of play is 
again the front wall, against which the ball must eventually be propelled. 
As you might imagine, my previous training in one-wall handball transferred 
quite effectively as long as the volley was confined to midcourt away from the 
unfamiliar side and back walls; this sort of help from previous training we 
call positive transfer. I soon discovered, however, that before or after hitting 
the front wall the ball might legitimately bounce off any other wall. Being 
a bit of a slave to my previous training, I was frequently lunging to the left 
to meet the ball, which was busily hitting the left wall and bouncing off to 
the right. Such interference from previous training is called negative transfer. 


WHAT TRANSFER 


We can draw a few insights from the handball incident. For one thing, 
maximum positive transfer results when a new task is extremely similar to 
one already learned, as in straightforward midcourt play. When the new 
task is only somewhat similar, then considerable interference, or negative 
transfer may develop. Since the old handball experience would not directly 
influence my current chess game, we might also guess that when past and 
present tasks are for all practical purposes completely dissimilar, then the 
effect is neither positive nor negative but simply neutral. Figure 6-1 pre- 
sents these generalizations diagrammatically. 


This diagram is helpful in describing transfer in a general way. Yet, when 


we get down to cases, we soon find some questions that this model cannot 


answer. For example, how do we measure the similarity between old and 
. , 


current tasks? Do we concentrate on the responses made in the two situations 
or on the stimuli? In this chapter we shall examine transfer in relation to 
stimuli, to responses, and to the interaction between them. Before attacking 
these problems, though, we shall describe some of the research techniques 


used in this area. 


Laboratory Procedures Used to Measure Transfer 


If you stop to think about ; Na 
it for a minute, it is quite remarkable that while looking in a mirror a 


woman can put on lipstick or straighten her hat, or that a man can shave or 
straighten his tie. Right and left and front and back are completely mixed 
up in the glass. Learning is obviously necessary in order for a person to per- 
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Similarity between task | and task 2 
; a P eB 
Figure 6-1. Effects of task similarity on transfer. Where task 1 and task 2 


are identical or very highly similar, performance on task 2 is facilitated ; where 
they are only slightly similar, performance on task 2 is hindered; where they 
are completely dissimilar, performance on task 2 is unaffected. (Adapted from 
E.S. Robinson, Amer. J. Psychol., 1927, 39, 297-312, p. 299.) 


Figure 6-2. Schematic 
diagram of a mirror- 
tracing apparatus. The 
Subject sits facing the 
Star, which is visible to 
him only in the mirror. 


Trial 2 


Figure 6-3. Changes 
in mirror-tracing per- 
formance as a conse- 
quence of practice. 
(From H.L. Kingsley 
and R. Garry, The na- 
ture and conditions of 
learning 2nd ed. Engle- 
wood Cliffs, NJ.: Pren- 
tice-Hall, 1957, p. 304.) Trial 14 Trial 15 


form a movement that is directed solely by mirror cues. Psychologists, there- 
fore, have been quite interested in the way mirror reversals are mastered. 

The procedure most often used to study this pE at learning is mirror 
tracing. A typical mirror tracing apparatus is shown in Figure Ord. = this task 
a subject is required to trace the outline of a star with only a miar s tefigetion 
to guide him. At first his experiences make it difficult for him to move his 
pencil in the correct direction. Subjects have remarked that the pencil 
seems to stick to the edge of the outline as if the outline were magnetized. 
This “magnetism” is, of course, nothing more than the subject’s own push 
in the wrong direction. With practice, however, he becomes able to fill in the 
igure 6-3 shows an actual record of the stages one person 
went through in learning to master this task. Notit that on the early trials 
a tremendous conflict in response is evident in the large number of little 
of the star where a change in direction is neces- 


star quite easily. F 


movements around each part i c ; 
sary. As learning progresses, these conflicts become less and less evident in the 


record. If sufficient practice is afforded to a subject, all interfering movements 
y what is happening in the case of a woman putting 


disappear. This is precisel int e 
A having while looking in the mirror. 


on her lipstick or of a man s f athe 
The conflict in the early stages of mirror drawing is largely the result of 
prior left-right and front-back training. For adults, earlier habits are the 


major source of interference in learning a new task. But later experience can 


produce interference too, in this case with the performance of earlier 
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learning. Suppose we have a rat learn one maze, then learn a second maze, 
and finally test his performance on the first maze again. We would expect 
that the rat would incorrectly use some habit related to the second maze 
in his retest on the first one. In fact, we would observe some such interference. 
This interference, contrary to our mirror-drawing example, is the result of an 
experience that followed rather than preceded the first test performance. 

These two cases provide examples of the two major methods used to 
study transfer in the laboratory. Schematically, the first of these procedures 
runs as follows: Learn Task A (or assume A to be known) and then test on 
Task B. In order to determine the effect of the prior learning of Task a on 
Task B, it is necessary, of course, to include a control group with no experience 
on Task A. In the simplest version, a single experimental group and a single 
control group are used in the following way: 


Experimental Group: Learn A Test B 
Control Group: Rest Test B 


This type of experimental model is called a proactive transfer design (from 
the Greek prefix pro, meaning before, hence transfer effects that are the result 
of previous activity). If Task A does have an effect on Task B, then the 
two groups should differ in their performances on Task B. If learning Task A 
helps to learn Task B then we say that proactive facilitation, or positive 
transfer, has taken place. If learning Task A depresses performance on Task B, 
then we say that proactive interference, or negative transfer, has occurred. If 


there is no difference between the two groups, clearly no transfer has taken 
place. 


The second major type of experimental 
has the following design: 


Procedure used to study transfer 
Experimental Group: Learn A 


Learn B Test on A 
Control Group: Learn A 


Rest Test on A 


their test performances on Task A. If B helps in t 
retroactive facilitation, or positive transfer has take 
it is because of retroactive interference, or negativ 


he performance of A, then 


n place; if B is a hindrance, 
e transfer, 
The mirror drawing test is an example of a proactive design, A subject 


comes to this task already having learned how to follow visual cues in moving 


to the right or to the left. Experiences have provided previous training. Now 
he is asked to learn a new way of orienting his movements in a changed 
right-left and front-back perceptual field, so his prior orientation hinders 
his performance in learning a new response during early trials. Under these 
conditions he shows proactive interference. 

Mirror drawing is also applicable in a retroactive transfer design. In one 
experiment of this type two groups of subjects are first given an opportunity to 
trace the outline of a star with their left hands (that is, the nonpreferred one). 
One group then gets to practice this task with their right hands (the preferred 
hand); the second group rests. Both groups then have a few more tries at 
tracing the pattern with their nonpreferred hand. The results of a great 
number of experiments show a positive bilateral transfer effect; that is, those 
who practice with the right hand perform better on subsequent trials with the 
left hand than those without practice. This experiment also presents evidence 
for retroactive facilitation. This facilitation probably consists of learning how 
to use cues from the mirror rather than of learning how to make specific 


movements. 


Stimulus Factors in Transfer 


In Chapter 3 we con- 
sidered one type of transfer based on stimulus factors, stimulus generalization. 


Here, a response transfers positively from one situation to the next because of 


the similarity of the situations. When the same response is required in two 
such similar situations, the amount of positive transfer to be expected from 
the old situation, A, to the current situation, B, is shown in Figure 6-4. As you 


Hi 


Figure 6-4. A typical 
stimulus generalization 
gradient. As stimuli be- 
come more dissimilar, 
less positive transfer is 
expected. D 


Amount of positive transfer 


Stimulus similarity 


can see, as the current stimulus situation becomes less and less similar to the 
old situation the amount of positive transfer decreases. h 
Let us examine an experiment by Kwang S. Yum that tested the relation: 
ships shown in Figure 6-4. Yum’s subjects first had paired-associate training 
in which the stimuli were geometric shapes and the responses were nonsense 
syllables. The next day they were shown a list of geometric shapes and asked 
to respond with the correct nonsense syllable. Now, only some of these Ue 
shapes were the same as the ones they had seen the previous day. The remain- 
ing test shapes were of varying similarity to the original patterns. Yum 
wished to see whether the similarity would cause subjects to respond with the 
nonsense syllable paired with the original pattern. The results, presented 


in Table 6, show that the greater the similarity, the greater the recall of the 
nonsense syllable. 


An Example of Positive Transfer 
as Related to Stimulus Similarity 


Transfer 


of Training 


Rated Similarity of Test Pattern Percentage of Subjects Responding 
to Original Geometric Pattern With Original Nonsense Syllable 


Least similar to original figure 36.32 
More similar 45.30 
Similar 


49.15 
Very similar 64.53 
Identical to original figures 84.62 


Note that even in the “least similar” category there was some positive transfer. 


When the response (in this case the nonsense syllable) is the same in the old 


and current situations, transfer is almost always positive and almost never 
negative. The amount of positive transfer de 


stimuli; the more the similarity the greater tl 


A more recent experiment examined the e 
sort of stimulus similarity. 


paired associates in which 


pends on the similarity of the 
he positive transfer, 

ffect on transfer of a different 
In this project each subject first learned a series of 


the stimulus was a meaningful w 
slow—corlep. In the second part of this experiment, for eac 


groups of subjects a different stimulus word w 
were fast, dim, and flaming. The response, cı 
same for all three groups. Slow 
show a subject the word slow, 


ord—for example, 
h of three different 
as substituted for slow. They 
orlep, however, remained the 
and fast are word associates—that is, if you 
his first associate is most often fast. When 
ocedure called the Semantic differential, slow 
ms of shared meanings. Fast and dim then are 


studied by a complex rating pr 
and dim belong together in ter 
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related to slow. Flaming, however, has little or nothing in common with slow; 
flaming—corlep essentially served as a control condition for evaluating the 
effect of the other two words in producing positive transfer. 

The experiment clearly showed that it was easiest to learn a second pair 
if the second stimulus word was a direct associate to the original stimulus 
term (fast—corlep). Words with similar meaning (dim—corlep) showed 
somewhat less positive transfer. Unrelated words (flaming—corlep) showed 
little or no transfer. 

These two experiments show that when a person is faced with a new situa- 
tion in which he must learn to make a previously practiced response his 
previous experience will probably help him. The amount of help will depend 
on the similarity of the new to the old situation. There will be some positive 


transfer no matter what form the similarity takes. 


Response Factors in Transfer 


A respected rule of thumb 


in psychology is that when you move from one 
ansfer if you keep stimuli constant but change the 


situation to another you will 


always get negative tr 
responses. A good example of this is a person who has learned to drive a car 
using a clutch and then switches to the same model car with automatic 
transmission. The stimuli are not terribly different but the responses have 
changed radically. This individual will find himself stabbing frantically with 
his left foot looking for the clutch and fumbling around with his right hand 
in the place where the gearshift should be. In the laboratory, learning XAD— 
PIV will be harder if you have previously learned XAD—GEJ. Let us first 
acknowledge the general applicability of this old rule and then turn to 
examine some of the exceptions. They help us to understand the more 
general rule better. 

Here is one exception: W. N. Kellogg and Edward L. Walker trained 
a dog to lift his right hind leg to a combination of buzzer (CS) and shock 
(UCS). They next attempted to train the dog to lift his left hind leg in 
response to the buzzer. They found positive transfer, for the dog learned 
to lift his left hind leg more quickly than he would have without having 
previously learned to respond with his right hind leg. Note that in this 
ginal and subsequent response were compatible. That is, 
ara by a sling in the experimental apparatus; raising his 
left leg after the buzzer did not prevent him from raising his right leg. In 
this situation, positive transfer occurred because the old response was not 
incompatible with the new response, and both responses were highly similar. 
Only, in fact, when new and old responses are compatible and somewhat simi- 
lar will positive transfer occur. As the similarity of the responses decreases, 


experiment the ori 
the dog was suppor 
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it very quickly increases the likelihood of negative transfer. Where the two 
responses are incompatible and dissimilar, negative transfer is greatest. 

Another, more subtle example of how compatibility of responses can make 
positive transfer possible may be seen in a study by Jarvis Bastian. First he 
had subjects learn a list of syllable-word pairs, like XAD—dark. Then he 
divided them into three groups that were differentiated by substitutes for 
dark. The substitute responses were light, black, and calm. Bastian found 
that the substitution of the first two words produced marked positive transfer. 
The reasons are not difficult to find. First, the words light and black are closely 
related to the word dark. Indeed, exactly 829 of 1008 college students give 
light as their first association to dark, Second, the responses are not incom- 
patible. Subjects can easily think the word dark between the stimulus and new 
response without interfering with their performance: thus, 


XAD > (DARK) > LIGHT. 


S; and transfer, the exact amount 
1 and S,, I P 
constant but vary the response, we ex 2. If we hold the stimulus term 


ange. A baseball player learning 
all handball, a college student 
examples of transfer situations 
Stimulus or response, In most 
S and the response terms, we 


golf, a one-wall handballer learning four-w. 
learning his second foreign language provide 
that defy simple analysis in terms of either 
such cases where we vary both the stimulu 
expect some negative transfer. 
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We all know individuals who can take difficult puzzles and tricky problems 
and solve them in a fraction of the time most of the rest of us could. Much 
of their facility is doubtless due to their being attracted to such pastimes 
and consequently having practiced many puzzles before. But their facility 
extends even to puzzles where the stimuli and responses could not bear any 
direct relationship to puzzles they have seen before. Here we have a situation 
of positive transfer where both stimulus and response factors have changed. 
Often such positive transfer can be ascribed to learning how to learn, that is, 
learning a mode of attack. 

Probably the best evidence for learning how to learn comes from a series of 
experiments done by Harry F. Harlow and his associates at the University of 
Wisconsin. In these experiments they presented a monkey with a series of 
discrimination tests each using two blocks. For each test these two blocks were 
clearly different in terms of some easily perceivable cue—one white, the other 
black; one cylindrical, the other conical; one striped, another plain; and so on. 
The monkey was allowed to look under only one block on each trial in a test 
series. Each time, some reward, such as a raisin, was in a well under one of 
these blocks. If, on his first test trial, the monkey lifted the white block and 
did not find the raisin, he would be using optimal strategy if on the second 
trial he looked under the black block. For the first few tests with different 
pairs of blocks, the monkey did no better than chance on both the first and 
second trials. As the monkey gained more experience in the test series, his 
second guess in any specific test series became consistently better. In fact, after 
most monkeys had done about 200 different cue-discrimination tasks, they 
chose the coret block about 90 per cent of the time on the second trial. With 
300 discrimination problems mastered, the monkeys were 95 per cent correct 
on their second trials. 

The monkeys seemed to learn general habits, in response to the total test 
situation. For ané thing, they learned which aspects were crucial and which 
irrelevant. For example, they learned not to respond to the position of the 
block, but to the pattern on it. Finally, they learned to switch. If the prize 
was not under the first pattern selected, they did not try that pattern again. 
If we had only had the opportunity to observe these monkeys being tested on 
their 300th problem, we might have been tempted to ascribe their performance 
to “insight.” Knowing their previous experience, however, gives us an under- 
standing of their current ability. It also suggests the role of learning how to 
learn in our daily lives. We continually encounter new situations to which 
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we must respond adaptively. These new situations are usually similar in form 
to things we have experienced before. Learning to learn efficiently enables us 
to evidence what we call insight, rather than random trial-and-error behavior. 
It is instructive to note that lower animals do not evince much learning to 
learn, not even cats or the low-order primate marmoset. 

Similar results have been found with rats running mazes and human beings 
learning lists of nonsense syllables. In both cases it takes longer to learn the 
first maze in a series or the first list in a series, than it does to learn subsequent 
ones. Figure 6-5 shows the number of trials subjects needed to learn lists of 
12 nonsense syllables as a function of the number of previous lists they had 
learned. Clearly, fewer trials are required to learn later lists than to learn 
earlier lists. Learning how to learn is involved here also. If a memory drum is 
being used, subjects must learn the rhythm of the device. In paired-associate 
learning individuals often attempt to bridge the pairs with a mediating word. 
Nonsense syllables are examined for their resemblance to real words. In 
addition, many irrelevant responses drop out. A person’s emotional response tO 
a new test situation subsides; noises go unnoticed; room stimuli that are not 
relevant are disregarded. What goes into learning how to learn is such a pot- 
pourri of acts which are specific to each new situation that it is difficult to state 
general principles. We can, however, stress the importance of making a? 


early determination of the essential stimuli and disregarding the irrelevant 
aspects of the learning situation. 


40 


Figure 6-5. Curve 
demonstrating “learning 
to learn” with verbal ma- 
terials. Note that nearly 
every succeeding list 15 
learned in fewer trials 
than those that preceded 
it. (From L.B. Ward, 
Psychol. Monogr., 1937, 
Vol. 49, No. 220, p. 13.) 
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Successive lists in order of learning 


By way of summary, then, we may say that positive and negative ‘onl 
are the results of carrying over both specific components and genera ors as 
of attack from one task to another. In talking about specific ra N 
the basis of transfer, we generally analyze an old and a ictal pet ai 
respective stimulus and response components. If stimu irae DAE E N 
response common to both tasks is kept constant, then positive sca. the anai 
The degree of similarity between stimuli and two tasks —— ie welll 
of positive transfer. If stimuli are kept constant and mp peek rea 
then negative transfer results in most cases. Poste a. ele es oad 
far as the second response is compatible with and highly s 


response. 
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Remembering 


and F org e tting For several weeks as part 
of an experiment on memory, a psychologist named Harold 
E. Burtt spiced his two-year-old son’s daily reading-time 
diet of Mother Goose and Winnie-the-Pooh with three 
selections from Sophocles. What was particularly remark- 
able was that he read these selections in the original Greek. 
The son’s reaction to this regimen was not reported. Six 
years later, however, Burtt tested for possible remnants 
of the passages in the child’s memory, Without explana- 
tion, he asked his now eight-year-old son to memorize 


these same three selections and three equivalent Greek 
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selections that the boy had never seen or heard. Burtt reasoned that if the boy 
learned the old selections more quickly, the exposure six years earlier may 
have had some effect in facilitating the later learning. Indeed, Burtt found 
that it took 435 repetitions for his son to learn the new selections but only 
317 to learn the old. This case provides rather striking anecdotal evidence 
for the persistence of the effects of learning. 

In this chapter we shall be concerned with whatever influences our ability 
to retain material we have learned. It is clear that understanding memory 
is central to understanding learning. Obviously, there could be no improvement 
from trial to trial if a learner did not remember something from preceding 
trials. He builds on what he remembers from previous experience. We call 
the hypothetical residue left by previous experience a Habit, a bond, or a 
memory trace. 

A second reason for our concern with memory in a book on learning is 
that we are interested in the fate of learned behavior over various time 
periods. The study of memory allows us to examine changes in learned 
behavior that are uncontaminated by further practice. 


Before we begin this study let us examine the three basic methods 


Psychologists use to measure memory in the laboratory: 


1. Recall. 
2. Recognition. 
3. Relearning. 


The first and second of these methods are quite familiar to all students. 
An essay examination is an example of a recall test. Recall requires a 
Person to tell what he has learned by producing the correct responses. A 
multiple choice question, on the other hand, is an example of a recognition 
measure. Recognition is a matter of discriminating what one has learned from 
a matter of identification. As any student can tell, 
recall is far more difficult than recognition. Relearning is a measure of re- 
tention not usually used in classroom tests. In order to get at this measure 
we ask a subject to learn something, say, a list of nonsense syllables. He then 
gets a rest period, which may vary in time from a few seconds to a few years: 
Next we ask him to relearn the initial material. If theres is a decrease in the 
time required, in the number of errors made, or i the trials needed to relearn 
the list, then we have some indication of the persistence of memory. Relearn- 
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Figure 7-1. Differences 
2 days in the amount retained 
as a function of the 
ii method of measurement. 
po (Adapted from CW. 
tme interval Luh, Psychol. Monogr., 
1922, 31, No. 142.) 


ing is a sensitive measure and will usually show the effect of memory even in 
cases where the other two measures do not detect any retention at all. Burtt’s 
boy relearned the three Greek selections in 317 repetitions, whereas it took 
him 435 repetitions to learn similar new material, His earlier experience with 
the material was helpful, an effect that could only be detected by the 
relearning procedure. If asked to recall or to recognize the previously learned 
material, the boy almost certainly would have been unable to do so. 


The three methods vary in sensitivity. Fig. 7-1 shows the effect of this 


variation over an extended time period. Recall, inevitably, produces the 


lowest scores. While in this figure recognition yields the highest retention 
scores, these scores could easily be lowered by embedding the to-be- 
recognized items in highly similar material. A nonsense syllable is easier to 
recognize in a group of colors than among similar syllables. This does not 
mean that a memory trace is stronger when we test through relearning Or 


recognition. It is just easier to detect the persistence of memory when we 
use a more sensitive measure. 


We have twice referred to memory as a “trace.” Psychologists are not yet 


in a position to state what the nature of this trace is, however, nor where in the 
nervous system it is deposited. Nevertheless, it seems reasonable to hypothesize 
that somehow events are recorded in order to explain their later recall. Some 
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betel cae Soa forgetting to the gradual fading of this hypo- 
EAT RE They reason ihat if the trace were heavily used 
S 7 Š u e retained. However intuitively appealing this notion 

3 s generally contradicted by research evidence. We know from our 
discušsión of classical conditioning that the best way to cause “forgetting” (or 
extinction) of a conditioned response is to evoke it repeatedly in the absence 
nat aE E stimulus, Repetition in and of itself does not prevent 

nor is forgetting primarily a consequence of disuse. 


g; 

Two Explanations of Forgettin 

What then is forgetting? i 
Zi shall discuss two important current explanations of this phenomenon. 
he first grows from previous research on perception, which has provided 
evidence that our remembrance of what we have seen tends to change in 


specific ways. It is hypothesized that all memory changes in these same ways, 
and that it is these alterations that produce the forgetting. For example, if 


Perceptual law Original figure Successive reproductions 
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Figure 7-2, Progressive changes in memory traces predicted by the per- 
ceptual laws. Direction of predicted change is indicated in each case by an 
arrow. (From C.E. Osgood, Method and theory in experimental psychology- 
New York: Oxford University Press, 1953.) 
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closure (the tendency to close an open figure), good figure (the tendency to 
perfect a figure), and symmetry (the tendency towards a balanced figure). 
These three principles are seen as physiological processes that are built-in 
aspects of the functioning of brain tissue. According to this view, because of 
these processes the trace laid down by experience becomes a more perfect and 
better balanced figure, and thereby loses some of its own characteristic 
qualities. This change in the trace, then, is the cause of the forgetting of the 
original figure. If a trace is particularly asymmetrical the eventual formation 
may have only little relation to the original material, and considerable 
forgetting may be a direct result. 

A second explanation of forgetting ascribes it to the tendency of habits 
to interfere with one another. How does this work? For example, in an ex- 
periment in verbal learning, a subject learns, say, the paired associate, 
“table—WEG.” After a week he returns for memory testing. During the 
week he has seen many tables and made many overt and covert verbal re- 
sponses to “table.” According to interference theory, these competing re- 
sponses crowd out the nonsense syllable “WEG” and cause forgetting. If the 
subject had not had any postexperimental interfering experiences a large share 
of forgetting would be avoided. 

Probably the most famous study of interference was reported by J.G. 
Jenkins and Karl M. Dallenbach in 1924. They 
number of lists of nonsense sy 


had two students learn a 
llables. One of the students went to sleep 
immediately after learning; the other student carried on with his normal 
daytime activities. At the end of One-, two-, four-, and eight-hour periods, 
the students were asked to recall the material they had learned. The sleeping 
subject was awakened after each of these intervals, only one interval being 
tested in any one night. Table 7 shows the average percentage of syllables 


Percentage of Syllables Forgotten 
as a Function of Time and Consciousness 


Time Elapsed 


Subject’s 

Condition 1 hr. 2 hrs. 4 hrs. 8 hrs. 
Awake | 54 | 69 78 91 
Asleep 30 | 46 45 44 


forgotten after each of the four different time intervals. According to these 
percentages the sleeping subject forgot less than the waking subject at each 
period. Note, however, that he did not have perfect retention at any point. 
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That 46 per cent of the material was forgotten during the first two hours may 
be due to the amount of time he lay awake before falling asleep or to thoughts 
oF dreams during sleep. From the second to the eighth hour there was no sig- 
nificant increase in forgetting for the sleeper. The awake subject, on the other 
hand, showed a progressive increase in forgetting as a consequence of per- 
forming regular daytime activities. As Jenkins and Dallenbach concluded: 
“Forgetting is not so much a matter of decay (due to disuse) as it is a matter 
of interference, inhibition or obliteration of the old by the new.” 


The Trace Hypothesis 


Having briefly stated the 


nature of these explanations, let us examine some of the relevant research 


evidence. The earliest experiment on the changing-trace hypothesis pertained to 
memory of perceptual form. Subjects examined an asymmetrical form, such 
as the one which is shown to the left in Figure 7-3. Each subject was then 
asked to reproduce the form repeatedly. After each reproduction the experi- 
menter would examine the newly drawn figure for changes. The series of 
drawings in Figure 7-3 shows a progressive trend toward a more symmetrical 
figure. In this case memory for perceptual form would seem to be changing 


in the direction predicted by the law of symmetry. 


Stimulus 
figure Successive reproductions 


Q Maad d o 


changes in the reproduction of a single stimulus 


Figure 7- pssit 
a pe |, (Adapted from F.T. Perkins, Amer. J. Psychol., 


figure by the same individua! 
1935, 44, 473—490, p. 473.) 


s flaw in the conduct of these experiments: 


the same subject drew all the figures for a given series. It is entirely possible, 
therefore, that the original memory trace itself did not change in the direction 
of becoming more symmetrical, rather that the subject tended to use his 
memory of his own poorly drawn initial figure as the one to copy from, rather 
than the original stimulus figure itself. Yet, if the initial reproduction showed 
the predicted changes, is this really a valid criticism? Yes, because most of the 
figures used in these experiments did not have a single predictable direction 
of change. Therefore, it was difficult to evaluate the changes that occurred. 
Experimenters who were favorable to the trace change theory saw every 


There is unfortunately one seriou: 
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alteration as evidence for a specific principle of change. Similarly, experi- 
menters who were unsympathetic to this viewpoint saw every change as 
fortuitous, and not dependent on any specific principles. Thus, the interpreta 
tion of the experiment finally boiled down to a question of theoretical per- 
suasion rather than experimental fact. 

To correct this error, Donald O. Hebb and E.N. Foord used figures with 
clearly predictable patterns of change. Two different groups of subjects 
were shown a stimulus figure and then tested for recognition, one group after 
five minutes, the other after 24 hours. They did not have to draw a reproduc- 
tion of this figure. Recognition was tested by showing the subjects a series of 
forms, all of which differed systematically from the initial stimulus form. 
Figure 7-4 shows one of these series. The original stimulus is labeled S. 


WOOOOOOOOO 
OQOOOOOOOO 
000000 


Figure 7-4. Series of stimuli used to te. 
jects were originally shown th 
and E.N. Foord, J. exp. Psyc 


st for memory-trace change. Sub- 
e stimulus labeled S. (Adapted from D.O, Hebb 
hol., 1945, 35, 335-348, p. 344.) 


Mistakes in recognition could veer in one of two directions: (a) toward 
the best, most symmetrical form (the circle numbered 1 
this best form (and toward circle 24). If the changin 
correct, then errors should tend toward circle 1 (princi 
than toward circle 24, Furthermore, there should be 
24 hours (during which the principle of change ha 
effective) than after five minutes. The results fail 
trend. Mistakes were not consistently 
there more mistakes in this direction f 
minute group. When careful experiment: 
traces do not change in the direction p 

Does this experiment rule out th 
in memory occur? Certainly 
Bartlett had subjects reprod 


), or (b) away from 
g trace hypothesis is 
ple of closure) rather 
more such errors after 
d sufficient time to be 
ed to reveal any such 
in the direction of circle 1, nor were 
or the 24-hour group than for the 5- 
S are performed, it seems that memory 
redicted by perceptual laws of change. 
e possibility that systematic changes 
not. In a series of ingenious experiments, F.C. 
uce stories and visual forms. He found that 
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Reproduced Stimulus Reproduced 
igure Word list | figures Word list 2 figure 


~<— Curtains in aradi 
iamond ina 


a window 
rectangle —— 


Ò <— Bottle Stirrup —> A 
( ~— Crescent moon Letter "C" —> ( | 


TI ~<—Bee hive Hat > ts 
CO ~<— Eye glasses OO Dumbbells —> C) 


erbal label afects the reproduction of 


D 


Figure 7-5. Examples of how a v 
an ambiguous figure. Subjects in one group were told that the first stimulus 
figure looked like “curtains in a window,” while subjects in the second group 
were told it “looked like a diamond in a rectangle.” Note the differences that 
appear in the figure reproduced by each group. ( Adapted from L. Carmichael 


et al., J. exp. Psychol., 1932, 15, 73-86, p. 80.) 


o take place, but that they are largely influenced by 
line of the original material does not 
are relevant to the labels the subject 
s figure as resembling some 
alter the original 


changes in memory d 
naming, or labeling. The general out 
change as much as do details which 
may give to a figure. If a subject sees an ambiguou: 
object familiar to him, his reproductions will gradually 
until it becomes the familiar object. The label he initially gives to the am- 
biguous figure shapes his reproductions and his “memory trace” of the figure. 
More direct evidence of the role of labeling comes from an experiment done 
by Leonard Carmichael, H. P. Hogan, and A. A. Walters. They presented 
subjects with a group of ambiguous figures, with instructions to draw them 
from memory after the entire group had been presented. Just before one of the 
each figure, he told one group of subjects that the 
d like a familiar object and named the object. He 
second group of subjects and told them the 
familiar object, again named, After going 
were asked to draw the figures. 
Is used in this experiment. 


experimenters exposed 
ambiguous figure looke 
showed the same figures to @ 


figures looked like some other 
through an entire series of figures, the subjects 


The middle column of Figure 7-5 shows materia 
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The outer columns present the names of the ambiguous figures given to the 
two groups of subjects. The outer columns present the types of figures the 
groups reproduced. 

Many of the drawings show a strong effect of the naming of the memory 
traces. Changes do occur in the reproduction of visual forms from memory, 
but these changes, contrary to the trace hypothesis, are largely the result of the 
name a subject provides for the original stimulus. In the case of the form 

T , shown back in Figure 7-2, the reason it may be reproduced as T 
is that the subject has remembered it as “looking like the capital letter, T.” 
Our memory does seem to move toward symmetrical forms. Still, this may 
not be a result of some innate neurophysiological process. Most familiar 
things that have names happen also to be symmetrical. 


An Interference Analysis of Forgetting 


Retroactive Interference. The interference analysis of forgetting suggests 


that material is lost to memory only when it is displaced by some other 
material. The mere passage of time between initial learning and recall does 
not cause forgetting. Some process or event must interpose itself to produce 
forgetting. In line with this, psychologists have devoted a good deal of time 
and energy to investigating the effect of various ways of filling the time 
interval between original learning and the recall of learning. The retroactive 


transfer experiment described in the previous chapter is one technique that 
was devised for this Purpose. Let us ana 


lyze this experiment in terms of 
interference theory. 


As pointed out in the preceding chapter most often studies of retroactive 
interference have used the following three-stage procedure: 


Stage 1: A paired associate task is presented to the subject. To make our 
discussion easier let us follow the fate of one pair, AB, 


Stage 2: An interpolated pair, with the same stimulus term, A, and a new 
response term, X, is presented to the subject for learning. 


Stage 3: The subject is now asked to relearn the original pair A—B or to 
recall B in the presence of A. 


If we examine this procedure car 
learned the pair A— 


When this learning 


efully we can see that the subject has 
B in Stage 1. In Stage 2 he must now respond with X. 
is complete the subject has learned the pair A—X. 


Stimulus A now tends to Produce both B and X, thus, age. Response X 


then interferes with Tesponse B in Stage 3 when the A—B pair must be 
relearned. Forgetting of B may take place because response X is interfering. 
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Using a similar analysis, Arthur W. Melton and J.McQ. Irwin had five 
groups of subjects learn a list of nonsense syllables. This was original learning 
(Stage 1). One of these groups then rested before being asked to recall the 
original list. The second through fifth groups were asked to learn an inter- 
polated list for 5, 10, 20, and 40 trials, respectively. This second learning 
constituted interpolated learning (Stage 2). At the end of interpolated learning 
all five groups were asked to recall the initial list (Stage 3). 

As might be predicted from interference theory, the groups that learned 
interpolated lists tended to have more difficulty learning the original list. 
In general, the more the interpolated practice, the more the interference. 


This experiment makes it clear that one source 


Proactive Interference. 
tween the time we learn something 


of forgetting is the experience we have b 
and the time we try to remember it. But isn’t there another possible source 
of interference in memory? What of all the experiences that precede what we 
have called original learning? This produces proactive interference. Many 
psychologists maintain that the chief cause of forgetting in adults is old 
habits. 

The way one psychologist tracked down 


interference on memory reads like a piece 0 
J. Underwood noticed that in some laboratories subjects seemed to be able 


to recall as much as 80 per cent of the material they had learned, whereas in 
other laboratories subjects were only able to recall about 10 per cent. Ebbing- 
haus, who certainly was a master at recalling nonsense syllables, evidenced 
recall of only about 35 per cent of the material he had learned. Could it be that 
a college student who had learned only one list could remember nonsense 
syllables better than a great scientist who had learned literally hundreds of 
different lists? It seemed incredible. Underwood began his investigation by 
er of preliminary questions: 


als used in the different labora- 


the pervasive effects of proactive 
f master detective work. Benton 


examining a numb 


1. Were there differences in the materi 
tories? By and large the answer was no. 

2. Did procedures vary from laboratory to laborator: 
was generally no. 

3. Did the subjects vary? Actua 
amount of experience they had had i 
e was the chief clue. Accordingly, he went back 
d carefully compared the treatment of 
sorting of evidence Underwood dis- 
e experiment, who had learned 


y? Again the answer 


lly, the subjects did vary in terms of the 
n verbal learning experiments. 


Underwood sensed that her 
to all the published experiments an 
experimental subjects. After extensive 


covered the key to the puzzle. Students in on 
16 different lists before the time they were asked to recall the last list, recalled 
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only about 20 per cent of the material they had learned. In a study in Under- 
wood’s laboratory, where each subject learned and recalled only one list, 
the recall rate was as high as 75 per cent. After examining the reports of 
results in 14 different experiments, Underwood concluded that the per- 
centage of material subjects recall is clearly related to the number of 
Previous lists they had learned (see Figure 7-6). 

What this means is that interference in recall is dependent in large measure 
on a subject’s activities and habits before a present task. Proactive inter- 
ference, in the form of already existing habits, is probably the major cause 
of forgetting. The phenomenal ability of children to recall details of events 
long forgotten by their parents is doubtless due to their shorter lives and 
consequent lesser degree of proactive interference. On the day when children 
begin to lose that fantastic ability to recall such details, we know they are 
beginning to grow up. 

Consideration of the implications of proactive interference brought Leo 
J. Postman and Underwood to another puzzle. The letter sequence CAT is 
memorized more easily than the letter sequence KJB. But CAT has many 
responses attached to it from Previous experience; these old habits should 
proactively interfere with learning. Either interference theory was wrong 
in this case or there are other potent sources of pr 
are less obvious. The one that turned out to be important in this context was 
proactive letter-sequence interference. Through careful tabulation of “which 
letters tend to follow which letters” in English, it soon became clear that KJB 
ts have previously experienced O follow- 


ing K far more frequently than J. Consequently, at the time of recall, O 
proactively interferes with J as a letter to follow K. 


oactive interference that 


We have identified two extra-experimental sources of interference that 
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Number of previous lists 


human beings bring to a laboratory memory situation: (1) interference from 
prior word association tendencies (cat-rat; black-white, and so on), and 
(2) interference due to past letter-sequence habits (CAT vs. KJB). These 
are both instances of the general rule that most material we learn must 
compete with pre-existing habits. This continual interference and “struggle 
for ascendancy” in our memory might be expected to result in a continuous 


jumble of thoughts. We are saved from this, however, by continually practicing 
finding our way to work, and conversing. 


important acts, such as dressing, 
ely to be replaced by 


Responses that are not practiced in this manner are lik 
new learning, or, in short, forgotten. 


Up to this point we have discussed the attrition of memory over relatively 
long time intervals. It is also apparent that we often need to recall material 
over skort time intervals. Remembering a telephone number, the name of the 
last few streets we passed in an unfamiliar town, or the preceding part of this 
long sentence are all examples of short-term memory. 

Early experimenters studied the memory span. In the procedure used, 
a subject is read progressively longer sequences of numbers or letters. The 
length of the longest series he can immediately recall indicates the size of 
his memory span. Since this length may vary from trial to trial, we usually 
measure the span a number of times and express a person's span as an 


average score. ; 
Is memory span about the same size for all kinds of material? According 

to one psychologist, the length of memory span generally equals the “number 
7 plus or minus 2.” What this phrase means is that an adult can normally 
remember 7 + 2 items, whether these items are numbers, letters, nonsense 
short-term memory 


syllables, or words. Regardless of the material, our 
he same. This seems rather strange when we consider 


17 + 2 letters, we can recall 7 + 2 words 
e an average of five letters apiece, 


capacity remains about t 
that whereas we can only reca 
even though the words probably hav 
making a total of 35 letters in all. 
What we seem to recall is not specific letters 0 


ful units. George A. Miller has suggested that we recall “chunks 
units) rather than the components of each 


formation (that is, meaningful 
chunk. The word “triskaidekaphobia” may exceed our memory span if we 
consider it as a series of 17 letters. But in this case, obviously, we recall not 
a number of letters, but one chunk of information. When Miller says that the 
approximate size of the memory span 7 + 2, he means 7 + 2 chunks. 


numbers but meaning- 
” of in- 
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III 


Newer Developments 


More recently Lloyd R. 
Peterson and Margaret Jean Peterson (1959) have developed a way of 
studying short-term memory that has yielded extremely surprising results. 
You would think that when presented with a single three-letter nonsense 
syllable, such as JIQ, an average college student would be capable of remem- 
bering it for nine seconds. As a matter of fact, he cannot! Peterson and 
Peterson presented students with such a single nonsense syllable and then 
asked for recall after either 3, 6, 9, 12, 15, or 18 seconds. Each student was 
only tested once. Since they wanted to minimize the possibility that subjects 
would rehearse the nonsense syllable, they asked them to fill the time be- 
tween presentation and recall by counting backward by threes from, say, 
66. Not more than 30 per cent of the students could recall JIQ after nine 
seconds had elapsed (see Figure 7-7). 

In a series of similar experiments, Bennett B. Murdock, Jr., had subjects 
recall three different types of materials: nonsense syllables, common words, 
and a set of three unrelated words. He asked them to recall the stimuli after 
they had been exposed to the Peterson and Peterson technique—that is, KJB, 
66, 63, 60 , recall KJB. The results for the three-letter nonsense syllable 
were similar to those reported by Peterson and Peterson. With the single 
English words, however, there was little or no forgetting over the entire 18- 
second recall interval. For the three unrelated words the subjects suffered 
a loss in memory comparable to that found for the nonsense syllables. Mur- 
dock’s complete results are shown in Figure 7-8, Notice the similarity among 
Murdock’s curves for nonsense syllables and three-word sequences and 


~ 1,0 Figure 7-7. Short- 
4 ee ea term recall of three-let- 
ter nonsense syllables, 
using the Peterson and 

oi Peterson counting tech- 
nique. This graph shows 
the proportion of correct 
recalls occurring with 
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2.8 seconds. Data points 
are actual; the curve has 
been fitted to these 
points. (From L.R. Pe- 
terson and M.J. Peter- 
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Figure 7-8. Compar- 
ison of the recall for 
three-letter nonsense syl- 
lables, simple English 
words, and sets of three 


Proportion of correct recalls 


common words. (From 0 3 6 9 12 15 
B.B. J K 

= Murdock, J. exp. Retention interval in seconds 

sychol., 1961, 62, 618- 

625, p. 619.) 


llables. This similarity again 


Peterson and Peterson’s curve for nonsense SY 
determined by the number 


suggests that the span of short-term memory is 


of chunks of information to be recalled. 
Let us briefly summarize what we have found out about memory. In dis- 


cussing memory we have concentrated on the other side of the same 
coin, forgetting. There is a theory that forgetting results from physiological 


changes in the brain which alter the o 
Adequate research methodology has not supporte! 
theory ascribes forgetting to the displacement of the origi 
material with other material. Retroactive interference is caused by new 
riginal material; proactive interference is caused 
d the original material. Proactive interference is 
the lives of human adults. Finally short- 
n, encompassing 7 + 2 chunks of 


riginal memory in certain lawful ways. 
d this theory. Interference 
nally learned 


learning following the © 
by learning which preceded t 
the more important of the two in 


we found, has a limited spa 


term memory, 
form of material. 


information for just about any 
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